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FOREWORD 

I 

The  Computer-Based  Instructional  Systems  Team  of  the  US  Army  Research 
Institute  for  the  Behavioral  and  Social  Sciences  performs  research  and  develop¬ 
ment  in  the  area  of  educational  technology  that  applies  to  military  training. 

Of  interest  are  methods  for  training  individuals  to  develop  and  utilize  instruc¬ 
tional  courseware  in  reasonable  time,  at  acceptable  cost.  ARI  research  in 
this  area  is  conducted  under  Army  Project  2Q263743A794 ,  FY  80  Work  Program. 

This  Research  Product  is  one  of  a  series  of  10  volumes  designed  to  provide 
guidance  on  the  application  of  the  Instructional  Systems  Development  model. 

The  work  was  accomplished  by  Mr.  Russel  E.  Schulz  and  Mrs.  Jean  R.  Farrell, 
Human  Resources  Research  Organization,  Contract  No.  DAHC19-78-C-0010  and 
personnel  of  the  ARI  Manpower  and  Educational  Systems  Technical  Area.  Person¬ 
nel  from  the  Directorates  of  Training  Development  at  Ft.  Belvoir,  VA  and  Ft. 
Gordon,  GA  provided  assistance  in  the  evaluation  of  the  work. 
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JOB  AID  MANUALS  FOR  PHASE  III-DEVELOP  OF  THE  INSTRUCTIONAL  SYSTEMS  DEVELOPMENT 
MODEL 


BRIEF 


Requirement : 

To  develop  a  series  of  job  aids  for  the  activities  identified  in  the 
Instructional  Systems  Development  Model  (ISD,  TRADOC  Pamphlet  350-30) . 


Procedure : 

A  series  of  job  aids  were  designed  and  developed  for  each  of  the  five 
phases  of  the  ISD  model:  ANALYZE.  DESIGN,  DEVELOP,  IMPLEMENT,  and  CONTROL. 
Each  job  aid  is  comprised  of  Descriptive  Authoring  Flowcharts  and  a  Job  Aid 
Manual  which  provide  specific  guidance,  examples,  and  references  necessary  to 
produce  the  product  specified  by  the  ISD  Block  it  covers. 


Utilization: 

These  job  aids  will  be  used  by  military  training  personnel  in  meeting  the 
requirements  of  the  ISD  model. 
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WHAT  ARE  JOB  AIDS? 


•  Job  Aids  are  intended  to  be  stand-alone,  step-by-step  procedural  guides  which 
we  hope  will  permit  you  to  turn  out  quality  instructional  products  quickly 
and  easily.  We  also  hope  that  they  will  be  equally  useful  to  individuals  at  all 
experience  levels  of  the  instructional  systems  development  process. 

•  Job  Aids  are  intended  to  address  real  needs.  Prior  to  the  development  of  the 
Job  Aids,  instructional  technology  personnel  (individuals  like  yourself)  at  the 
U.S.  Army  Signal  Center  and  the  U.S.  Army  Engineer  School  were  surveyed  to 
determine  specific  ISD  needs— those  areas  in  which  they  had  the  greatest  need  for 
assistance  and  information.  Emphasis  was  placed  on  satisfying  these  needs  in  the 
development  of  the  Job  Aids. 

•  Job  Aids  use  the  same  classification  system  for  identifying  the  activities  that 
must  be  performed  in  instructional  systems  development  (ISD)  as  does 
TRADOC  Pamphlet  350-30  (Interservice  Procedures  for  Instructional  Systems 
Development). 


WHAT  IS  THE  CLASSIFICATION  SYSTEM  USEV  IN  TRAVOC 
PAMPHLET  350-30  AMD  JOB  AWS? 

•  TRADOC  Pamphlet  350-30  suggests  that  instructional  systems  development  be  con¬ 
ducted  in  five  phases: 

—  Analyze 
—  Design 
—  Develop 
—  Implement 
—  Control 

•  For  those  of  you  who  are  unfamiliar  with  TRADOC  Pamphlet  350-30  we  suggest 
you  read  the  brief  description  of  each  phase  of  the  ISD  process  as  shown  in 
Table  1.  In  the  TRADOC  Pamphlet  each  ISD  phase  is  divided  into  specific 
activities  called  ISD  blocks.  Table  2  shows  these  ISD  blocks  and  Table  3  shows 
the  outcome  of  each  block. 

•  Job  Aids  cover  the  activities  required  for  the  first  three  phases  of  the 
TRADOC  Pamphlet  (i.e.,  Analyze,  Design,  and  Develop  instructional  systems). 

The  Aids  cover  each  ISD  block  within  these  phases  except  for  ISD  Block  1.1, 
Analyze  Job. 
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Table  1 


FIVE  PHASES  OF  INSTRUCTIONAL  SYSTEMS  DEVELOPMENT  (ISD) 

THE  FIVE  PHASES  ARE: 


PHASE  I 

ANALYZE 


Inputs,  processes,  and  outputs  in  Phase  I  are  all  based  on  job  Information.  An  inventory  of  job 
tasks  is  compiled  and  divided  into  two  groups:  tasks  not  selected  for  instruction  end  tasks 
selected  for  instruction.  Performance  standards  for  tasks  selected  for  instruction  are  determined 
by  interview  or  observation  at  job  sites  and  verified  by  subject  matter  experts.  The  analysis  of 
existing  course  documentation  is  done  to  determine  if  all  or  portions  of  the  analysis  phase  and 
other  phases  have  already  been  done  by  someone  else  following  the  ISD  guidelines.  As  a  final 
analysis  phase  step,  the  list  of  tasks  selected  for  instruction  is  analyzed  for  the  most  suitable 
instructional  setting  for  each  task. 


rurwb  il 

DESIGN 


Beginning  with  Phase  II.  the  ISD  model  is  concerned  with  designing  instruction  using  the  job 
analysis  infcrmcticn  from  Phase  i.  The  first  step  is  tne  conversion  of  each  task  selected  for 
training  into  a  terminal  learning  objective.  Each  terminal  learning  objective  is  then  analyzed  to 
determine  learning  objectives  and  learning  steps  necessary  for  mastery  of  the  terminal  learning 
objective.  Tests  are  designed  to  match  the  learning  objectives.  A  sample  of  students  is  tested  to 
insure  that  their  entry  behaviors  match  the  level  of  learning  analysis.  Finally,  a  sequence  of 
instruction  is  designed  for  the  learning  objectives. 


PHASE  HI 

DEVELOP 


The  instructional  development  phase  begins  with  the  classification  of  learning  objectives  by 
learning  category  so  as  to  identify  learning  guidelines  necessary  for  optimum  learning  to  take 
place.  Determining  how  instruction  is  to  be  packaged  and  presented  to  the  student  is 
accomplished  through  a  media  selection  process  which  takes  into  account  such  factors  as 
learning  category  and  guideline,  media  characteristics,  training  setting  criteria,  and  costs. 
Instructional  management  plans  are  developed  to  allocate  and  manage  all  resources  for 
conducting  instruction.  Instructional  materials  are  selected  or  developed  and  tried  out.  When 
materials  have  been  validated  on  the  basis  of  empirical  data  obtained  from  groups  of  typical 
students,  the  course  is  ready  for  implementation 


PHASE  IV 

IMPLEMENT 


Staff  training  is  required  for  the  implementation  of  the  instructional  management  plan  and  the 
instruction.  Some  key  personnel  must  be  trained  to  be  managers  in  the  specified  management 
plan.  The  instructional  staff  must  be  trained  to  conduct  the  instruction  and  collect  evaluative 
data  on  all  of  the  instructional  components.  At  the  completion  of  each  instructional  cycle, 
management  staff  should  be  able  to  ise  the  collected  information  to  improve  the  instructional 
system. 


phase  v 

CONTROL 


Evaluation  and  revision  of  instruction  are  carried  out  bv  personnel  who  preferably  are  neither 
the  instructional  designers  nor  the  managers  of  the  course  under  study.  The  first  activity 
(internal  evaluation)  is  the  analysis  of  leerner  performance  in  the  course  to  determine  instances 
of  deficient  or  irrelevant  instruction.  The  evaluation  team  then  suggests  solutions  for  the 
problems.  In  the  external  evaluation,  personnel  assess  job  task  performance  on  the  job  to 
determine  the  actual  performance  of  course  graduates  and  other  job  incumbents.  All  collected 
date,  internal  end  external,  can  be  used  as  duality  control  on  instruction  and  as  input  to  any 
phase  of  the  system  for  revision. 
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Table  2 


PHASE  I 


PHASE  II 


PHASE  III 


PHASE  IV 


PHASE  V 


ISO  BLOCKS  IN  EACH  OF  THE  FIVE  ISO  PHASES 


THE  BLOCKS  IN  EACH  PHASE  ARE: 


► 


nr.i 

implement 

instructional 

management 

PLAN 


► 


nr  2 

CONDUCT 

instruction 


2.1 

.  CONDUCT 
INTERNAL 
EVALUATION 


► 


2.2 

CONDUCT 

EXTERNAL 

EVALUATION 


2  3 

REVISE 

SVSTEM 
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Table  3 

OUTCOMES  OF  ISO  BLOCKS 


THE  OUTCOMES  OF  THE  BLOCKS  ARE 


.1  . . .  a  list  of  tasks  performed  in  a  particular  job. 

.2 . .  .  a  list  of  tasks  selected  for  training. 

.3- . .  a  job  performance  measure  for  each  task  selected  for  instruction. 

.4. . .  an  analysis  of  the  job  analysis,  task  selection,  and  performance  measure 
construction  for  any  existing  instruction  to  determine  if  these  courses  are 
usable  in  whole  or  in  part. 

.5. . .  selection  of  the  instructional  setting  for  task  selected  for  instruction. 


.1  ...  a  learning  objective  for  and  a  learning  analysis  of  each  task  selected  for 
instruction. 

2. . . .  test  items  to  measure  each  learning  objective. 

.3 . .  .  a  test  of  entry  behaviors  to  see  if  the  original  assumptions  were  correct. 

.4 . .  .  the  sequencing  of  all  dependent  tasks. 


the  classification  of  learning  objectives  by  learning  category  and  the 
identification  of  appropriate  learning  guidelines. 

the  media  selections  for  instructional  development  and  the  instructional 
management  plan  for  conducting  the  instruction. 

the  analysis  of  packages  of  any  existing  instruction  that  meets  the  given 
learning  objectives. 

the  development  of  instruction  for  all  learning  objectives  where  existing 
materials  are  not  available. 

field  tested  and  revised  instructional  materials. 


.1 . .  .  documents  containing  information  on  time,  space,  student  and  instructional 
resources,  and  staff  trained  to  conduct  the  instruction. 

.2  . .  .  a  completed  cycle  of  instruction  with  information  needed  to  improve  it  for 
the  succeeding  cycle. 


.1 . .  .  data  on  instructional  effectiveness. 

,2.  . .  data  on  job  performance  in  the  field. 

,3.  .  .  instructional  system  revised  on  basis  of  empirical  data. 
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WHAT  SOURCES  OF  INFORMATION  WERE  USEV  IN  THE 
DEVELOPMENT  OF  JOB  AIDS? 

•  Job  Aids  are  not  just  a  re-hash  of  TRADOC  Pamphlet  350-30.  We  use  the 
same  classification  system  for  1SD  phases  and  the  blocks  within  the  phases 

as  does  the  TRADOC  Pamphlet.  However,  the  guidance  and  information  provided 
in  the  Job  Aids  come  from  a  variety  of  sources,  the  TRADOC  Pamphlet  being 
only  one  such  source.  We  have  gathered  information  from  any  source  that  we 
could  locate.  If  the  information  was  judged  to  be  good  it  was  included  in  the 
Job  Aids.  In  some  instances  the  information  in  the  Job  Aid  is  based  solely  on  the 
educational  technology  experience  of  the  project  staff. 

•  It  is  not  within  the  scope  of  this  Introduction  to  list  all  sources  of  information 
examined  or  used  in  the  development  of  the  Job  Aids.  However,  in  addition 
to  TRADOC  Pamphlet  350-30  examples  of  other  sources  of  information  would 
include  the  following  types: 

—  TRADOC  Circulars 

—  DA  Pamphlets 

—  Printed  Guidance  prepared  by  TRADOC  Schools  (e.g.,  U.S.  Army 
Signal  Center) 

—  Army  Research  Institute  Documents 
—  HumRRO  publications 
—  Other  military  and  civilian  agencies 


5 


WHAT  JOB  AIPS  ARE  PRESENTLY  AVAILABLE  ANV  WHAT  VO 
THEY  CONSIST  OF? 

•  There  are  thirteen  Job  Aids  presently  available.  Each  Job  Aid  is  comprised 
of  two  documents.  A  brief  description  of  each  is  provided  below:  (A 
complete  description  of  how  to  use  each  is  given  on  the  pages  that  follow.) 

—  Descriptive  Authoring  Flowcharts.  The  Descriptive  Authoring  Flowcharts  (usually 
referred  to  as  Flowchart  Manuals)  are  the  primary  documents  used  in  the 
Job  Aids.  They  direct  the  user  to  specific  guidance,  examples  and  references 
provided  in  the  Job  Aid  Manuals. 

—  Job  Aid  Manuals.  As  stated  above,  the  Job  Aid  Manuals  provide  the  specific 
guidance,  examples  and  references  necessary  to  produce  the  product  specified 
by  the  ISD  Block  they  cover.  In  addition,  each  Job  Aid  Manual  contains  one 
or  more  Worksheets  to  use  in  the  development  of  the  product. 

•  Another  important  part  of  the  Job  Aids  package  is  of  course  the  document 
you  are  presently  reading.  Introduction  to  the  Use  of  Job  Aids  and  Job 
Aid  Resource  Manual. 

•  The  specific  Job  Aids  available  are:  (Flowchart  Manual  and  Job  Aids  Manual 
for  each). 

—  Job  Aid  for  Selecting  Tasks  for  Training  (ISD  1.2) 

—  Job  Aid  for  Conducting  Task  Analysis  (ISD  1.3) 

—  Job  Aid  for  Analyzing  Existing  Courses  (ISD  1.4) 

—  Job  Aid  for  Selecting  Instructional  Settings  (ISD  1.5) 

—  Job  Aid  for  Developing  Objectives  (ISD  II.  1) 

—  Job  Aid  for  Developing  Tests  (ISD  II. 2) 

—  Job  Aid  for  Describing  Entry  Behavior  (ISD  II. 3) 

—  Job  Aid  for  Determining  Sequence  and  Structure  (ISD  II. 4) 

—  Job  Aid  for  Specifying  Learning  Events  and  Activities  (ISD  III.l) 

—  Job  Aid  for  Specifying  Instructional  Management  Plan  and  Delivery 
System  (ISD  UI.2) 

—  Job  Aid  for  Review  and  Selection  of  Existing  Materials  (ISD  III.3) 

—  Job  Aid  for  Developing  Instruction  (ISD  HI.4) 

—  Job  Aid  for  Validating  Instruction  (ISD  III.5) 
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WHAT  ARE  THE  MAW  PARTS  OP  THE  FLOWCHART  MANUAL? 


•  Scan  through  a  few  pages  of  youi  Flowchart  Manual.  Observe  the  following: 

—  Flowchart  symbols  used 

—  Instructions  or  questions  within  the  flowchart  symbols 

—  Supplemental  information  opposite  most  of  the  flowchart  symbols 

—  Flowchart  block  and  page  numbering  system 

•  For  a  complete  description  of  each  of  the  main  parts  of  the  Flowchart  Manual 
see  the  pages  that  follow. 
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WHAT  FLOWCHART  SYMBOLS  ARE  USEV  W  THE  FLOWCHART  MANUAL? 


•  Flowchart  Symbols 

—  Only  five  symbols  are  used  in  the  Flowchart  Manual.  These  symbols  and  the 
instructions  within  them  act  as  a  road  map  to  lead  you  step-by-step  through 
the  process  of  developing  your  particular  product.  We  believe  that  after  you 
have  gotten  used  to  using  the  Flowchart  Manual  you  will  find  it  a  very  useful 
control  document.  The  five  symbols  used  are  as  follows: 


) 


Start-Stop  Symbol  —  Indicates  either  the  start  or  stop 
of  the  activities  called  for  in  the 
Flowchart  Manual. 


Decision  Symbol 


Manual  Symbol 


—  Indicates  that  you  must  make  a 
decision  at  this  point  which  will 
determine  the  path  that  you  take 
thru  the  Flowchart  Manual. 


—  Indicates  that  you  are  to  refer  to 
the  Job  Aid  Manual  for  specific 
additional  guidance  or  instruction 
shown  in  the  symbol. 


Rectangle  Symbol  —  Indicates  an  activity  that  must  be 
performed  but  does  not  require 
specific  additional  guidance  or 
instruction  in  the  Job  Aid  Manual. 
(In  some  cases  the  user  is  given 
the  option  of  going  to  the  Job 
Aid  Manual  to  see  a  completed 
example  of  the  activity  called  for 
in  the  rectangle  symbol). 


Go  To  Symbol  —  Indicates  a  branch  to  some  other 
flowchart  block.  The  branch  will 
either  be  to  a  previously  encountered 
block  or  will  jump  you  over  blocks 
that  can  be  omitted. 


\ 


WHAT  INSTRUCTION  IS  PROVWEV  WITHIN  THE  FLOWCHART 
SYMBOLS? 

•  Each  flowchart  symbol  except  the  Decision  Symbol  contains  a  brief  statement 
of  the  activity  that  you  are  to  perform.  If  this  activity  requires  the  completion 
of  part  of  a  Worksheet  the  specific  part  of  the  Worksheet  will  be  identified 
(remember,  each  Job  Aid  includes  one  or  more  Worksheets).  Decision  blocks 
always  contain  a  question  that  can  be  answered  with  a  yes  or  no  answer.  The 
branch  you  take  after  the  decision  block  will  depend  upon  your  answer. 


WHAT  IS  THE  PURPOSE  OF  THE  SUPPLEMENTAL  INFORMATION 
PROVIVEV  IN  THE  FLOWCHART  MANUAL? 

•  The  supplemental  information  that  is  located  beside  most  of  the  flowchart  symbols 

serves  the  following  purposes: 

—  Provides  a  more  complete  description  of  the  steps  or  activities  that  must  be 
performed  in  the  ISD  Block  you  are  working  in  than  does  the  flowchart  itself. 

—  Refers  you  to  specific  pages  within  the  Job  Aid  Manual  for  specific  guidance, 
examples  and  references  needed  for  completing  the  activity  called  for  in  the 
flowchart  block.  (This  is  associated  with  the  Manual  symbol.) 

—  For  some  flowchart  blocks  (rectangle  symbol)  examples  of  the  completed  activity 
are  shown  in  the  Job  Aid  Manual.  The  supplemental  information  indicates  the 
specific  page  in  the  Job  Aid  Manual  containing  the  example.  However,  the  user 
has  the  option  of  going  to  the  Job  Aid  Manual  to  see  the  example.  (The  Manual 
symbol,  on  the  other  hand,  requires  the  user  to  go  to  the  Job  Aid  Manual.) 

—  Acts  as  an  executive  summary  which  will  allow  commanders  and  supervisors  to 
obtain  a  picture  of  the  activities  required  by  the  Job  Aid  without  reading  the 
entire  Job  Aid  Manual. 


WHAT  15  THE  FLOWCHART  BLOCK  A NV  PAGE  NUMBERING  SYSTEM? 

•  The  flowchart  block  and  page  numbering  system  is  as  follows: 

—  Flowchart  blocks  are  numbered  so  that  they  can  be  easily  referred  to. 

—  The  page  numbers  in  each  of  the  13  Flowchart  Manuals  are  preceded  by  an 
identifying  letter  unique  to  a  specific  ISD  Block.  (E.g.,  The  Flowchart  Manual 
pages  for  ISD  Block  1.2  go  from  A-l  to  A-15  whereas  for  ISD  Block  1.3  the 
Flowchart  Manual  pages  go  from  B-l  to  B-15.)  This  same  page  numbering  system 
is  also  used  in  the  Job  Aid  Manuals. 
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HOW  VO  1  USE  THE  JOB  AIV  MANUAL  ANV  WHAT  ARE  THE 
MAIN  PARTS  OP  IT? 

•  It  is  unlikely  that  you  will  need  to  refer  to  every  page  in  the  Job  Aid  Manual. 

As  previously  stated,  the  Job  Aid  Manuals  are  used  as  supplements  to  the  Flow¬ 
chart  Manuals  that  direct  you  to  specific  pages  within  the  Job  Aid  Manuals. 

Therefore,  DO  NOT  ATTEMPT  TO  USE  THE  JOB  AID  MANUALS  INDEPENDENTLY 
OF  THE  FLOWCHART  MANUALS. 

•  Scan  through  a  few  pages  of  your  Job  Aid  Manual.  Observe  the  following: 

—  Partial  flowcharts  shown  at  the  top  of  pages 

—  Questions  written  in  script  that  appear  on  most  pages 
—  Completed,  or  partially  completed  examples  of  Worksheets 


WHAT  IS  THE  PURPOSE  OP  THE  PARTIAL  PLOWCHARTS  AT  THE 
TOP  OP  SOME  PAGES  OP  THE  JOB  AIV  MANUAL? 

•  When  you  are  referred  to  the  Job  Aid  Manual  you  will  find  a  partial  flowchart  at 
the  top  of  the  Job  Aid  Manual  page.  You  are  to  remain  working  with  the  Job 
Aid  Manual  until  you  come  to  another  partial  flowchart.  Then  return  to  the 
Flowchart  Manual. 

•  The  partial  flowcharts  are  identical  to  those  shown  in  the  Flowchart  Manual. 
They  serve  as  an  additional  reminder  of  the  activity  being  dealt  with  at  the 
moment. 
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WHAT  IS  THE  PURPOSE  OF  THE  QUESTIONS  WRITTEN  IN  SCRIPT 
THAT  APPEAR  ON  SOME  PAGES  OF  THE  JOS  AW  MANUAL? 


•  The  questions  written  in  script  are  our  way  of  telling  you  what  follows.  They 
highlight  such  things  as: 

—  The  purpose  of  performing  a  certain  activity 

—  How  the  activity  is  performed 

—  What  sources  are  available  for  performing  the  activity  and  how  good  they  are 

—  What  the  Worksheet  looks  like  after  the  activity  is  performed 


UJHAT  IS  THE  PURPOSE  OF  THE  COMPLETEV  OR  PARTIALLY 
COMPLETEV  EXAMPLES  OF  WORKSHEETS? 


•  As  previously  stated,  every  Job  Aid  Manual  uses  one  or  more  Worksheets 
(located  in  a  pocket  at  the  back  of  the  Manual).  The  Worksheets  permit  you  to 
produce  (and  document)  the  product  called  for  in  the  ISD  Block. 

•  Whenever  you  are  required  to  make  an  entry  on  a  Worksheet  an  example  of  that 
type  of  entry  will  be  shown  in  the  Job  Aid  Manual  and  will  usually  be  circled  so 
as  to  make  it  stand  out.  It  is  hoped  that  these  examples  will  give  you  a  clear  idea 
of  what  is  required  on  the  Worksheet. 
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WHAT  POES  THIS  ALL  MEAN  AND  WHAT  W  I  VO  NOW? 


•  In  this  Introduction  we  have  attempted  to  explain  the  following: 

—What  Job  Aids  are 

—  The  classification  system  (ISD  Phases  and  Blocks)  used  in  the  Job  Aids 

—  Sources  of  information  used  in  the  development  of  Job  Aids 

—  Job  Aids  presently  available 

—  A  description  of  Flowchart  Manuals 

—  A  description  of  Job  Aid  Manuals 

•  If  you  feel  that  you  have  an  adequate  understanding  of  the  above,  return  to  the 
Flowchart  Manual  now.  You  will  be  referred  to  specific  pages  in  the  Resource 
Manual  (the  remainder  of  this  document)  as  you  need  the  information  contained 
in  them.  Do  not  attempt  to  read  the  Resource  Manual  now. 

RETURN  TO  THE  FLOWCHART  MANUAL  NOW 
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HOW  CAN  THE  RESOURCE  MANUAL  HELP  ME? 

The  purpose  of  this  resource  manual  is  to  assist  you  in  the  formation  of  a  data* 
based  system  for  decision  making  in  the  Analysis  Phase  of  the  Instructional  Systems 
Development  (ISD).  In  order  to  make  logical  and  objective  decisions  based  on  conditions 
and  needs  in  the  field,  you  must  collect,  organize,  analyze,  and  document  job  significant 
data  (information).  Such  data  includes  many  specifics  under  the  broad  categories  of 
job  background  data,  target  population  data,  and  critical  task  data.  The  specifications 
of  specific  data  requirements  and  sources  of  this  data  should  be  part  of  the  overall 
Job  Analysis  Plan. 
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WHAT  ARE  SOME  SOURCES  OF  JOB  SIGNIFICANT  PATA? 

There  are  many  sources  of  data  to  support  a  job  analysis. 

These  sources  include  such  things  as: 

•  Technical  Manuals 

•  Field  Manuals 

•  Army  Regulations 

•  Circulars  and  Phamplets 

•  Programs  of  Instruction 

•  Soldier’s  Manuals 

•  Previous  Task  Lists 

•  Documentation  from  the  Systems  Engineering  Era 

•  Reports  from  outside  agencies,  i.e.,  Army  Research  Institute,  HumRRO, 
and  other  military  and  civilian  research  organizations 

•  Internal  Research  Reports 

•  Tables  of  Organization  and  Equipment  and  Tables  of  Distribution  and 
Allowances 

•  Civilian  Publications  (technical  journals  and  professional  publications) 

•  Equipment  Modification  Work  Orders 

•  CODAP  (Comprehensive  Occupational  Data  Analysis  Programs) 

•  Field  Surveys 

•  Panels  of  Experts 

WHICH  SOURCES  OF  VATA  ARE  I SICLUVEV  IN  THE  RESOURCE 
MANUAL? 

Each  of  the  sources  listed  is  useful  for  fulfilling  specific  needs  in  the  Analysis  Phase 
of  ISD.  The  Job  Analysis  Plan  should  specify  exactly  which  items  of  data  will  be  needed 
and  the  recommended  source<s)  for  each  item.  In  this  way  all  the  data  can  be  accessed  and 
ready  for  use  as  soon  as  it  is  needed.  The  last  three  sources  on  the  list,  CODAP,  Field 
Surveys,  and  Consensus  Groups  or  Panels,  are  frequently  cited  in  the  Job  Aids  for 
specific  items  of  information.  How  to  use  these  sources  is  the  subject  of  this  manual. 


WHAT  IS  COVAP? 


To  provide  personnel  managers  and  training  managers  with  the  reliable  job  data 
needed  for  job  and  task  analysis,  the  Deputy  Chief  of  Staff  for  Personnel  has  selected  the 
occupational  survey  questionnaire  for  data  collection  and  CODAP  (Comprehensive 
Occupational  Data  Analysis  Programs)  as  the  system  for  processing,  reporting,  and  anal¬ 
yzing  this  data.  The  combination  of  questionnaire  and  CODAP  is  currently  being  used  by 
all  the  U.S.  Armed  Forces  to  support  their  occupational  survey  and  job  analysis  efforts. 
This  automated  data  system  provides  information  in  such  areas  as:  duties  and  tasks 
performed  by  job  and  duty  incumbents;  types  of  equipment,  tools,  and  vehicles  used 
and  maintained;  special  skills  and  knowledge  which  must  be  met  by  job  incumbents; 
quality  and  quantity  of  training  received  or  required;  physical  and  mental  demands;  and 
special  items  pertaining  to  personal  and  job  background  information,  work  environment, 
and  job  satisfaction. 
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WHEN  SHOULV  COVAP  REPORTS  BE  USEV? 


Whenever  data  has  already  been  prepared  by  CODAP  it  should  be  used  in  preference 
to  school  conducted  surveys  in  order  to  prevent  duplication  of  effort.  CODAP  has  the 
capability  of  supplying  all  your  data  needs.  It  is  the  responsibility  of  each  Army  service 
school  to  initially  provide  the  Army  Occupational  Survey  Program  with  the  input  it  must 
have  to  supply  your  job  analysis  needs,  and  also  to  develop  a  job  analysis  plan  which 
allows  sufficient  time  to  access  the  necessary  data. 

Of  particular  use  in  job  analysis  are  Group  Summary  Reports.  The  Job  Aids 
suggest  that  you  obtain  these  reports  for  documenting  such  information  as:  tasks 
performed  in  each  duty  position  (ask  for  GPSUM6  report  for  your  MOS),  and  percentage 
of  soldiers  in  the  skill  level  performing  each  task  (ask  for  GPSUM  2).*  Given  sufficient 
lead  time  CODAP  can  also  make  up  special  reports  to  provide  ratings  on  task  selection 
factors  such  as,  time  to  train  0  TE,  consequences  of  inadequate  performance,  and  proba¬ 
bility  of  emergency  performance-  'sk  for  FACSUM  report). 


HOW  ARE  COVAP  REPORTS  OBTAINED? 

In  order  to  obtain  CODAP  data  you  should  first  check  with  your  supervisor  to  see  if 
the  information  you  need  has  already  been  accessed.  If  it  has  not,  write  to: 

Commander 

US  Army  Military  Personnel  Center 
ATTN:  DAPC-MSP-D 
2641  Eisenhower  Avenue 
Alexandria,  VA  22311 

or  call: 

325-9272/9493  (AUTOVON  221-9272/9493). 

Allow  at  least  three  weeks  for  the  reports  to  arrive  at  your  school.  The  necessary 
lead  time  could  be  much  longer  if  you  are  requesting  special  information  which  CODAP 
has  not  yet  collected.  It  is  recommended  that  you  obtain  the  two  official  guides  from 
MILPERCEN:  the  US  Army  Military  Occupational  Data  Bank,  and  the  US  Army  Occupa¬ 
tional  Survey  Program. 


*Kecp  in  mind  that  these  percentages  are  based  on  the  peacetime  conditions  in  which  soldiers  are 
presently  being  surveyed.  Adjustments  should  be  made  for  combat  tasks. 


MAT  IS  A  FORMAL  FIELD  SURVEY? 


A  formal  field  survey  is  similar  to  the  type  of  questionnaire  survey  conducted  by 
the  Army  Occupational  Survey  Program,  only  it  is  conducted  by  instructional  development 
personnel  within  an  Army  service  school. 

The  use  of  questionnaires  permits  the  job  analysis  team  to  make  limited  contact  with 
large  numbers  of  personnel;  thus  large  amounts  of  information  can  be  collected  at  a  rela¬ 
tively  low  cost.  Questionnaires  can  be  mailed  to  personnel  who  are  asked  to  complete 
and  return  them,  or  they  can  be  administered  to  groups  of  job  incumbents  and/or  super¬ 
visors  by  local  personnel  who  have  the  responsibility  and  authority  to  make  sure  all 
questionnaires  are  completed  and  returned. 


MEW  SHOULD  FORMAL  FIELD  SURVEYS  BE  USED? 

Whenever  time  does  not  allow  you  to  access  information  from  the  Army  Occupa¬ 
tional  Survey  Program,  an  alternate  data  collection  method  may  be  used.  Formal  field 
surveys  are  suggested  as  an  alternate  data  source  in  the  ISD  Job  Aids.  Should  you  decide 
to  conduct  a  formal  field  survey  be  sure  to  obtain  permission  from  MILPERCEN  in 
accordance  with  the  guidelines  in  AR  600-46. 


HOW  IS  A  FIELD  SURVEV  QUESTIONNAIRE  DESIGNED? 


•  Types  of  Questionnaires 

There  are  two  types  of  questionnaires,  the  closed  form  and  the  open  form.  We 
suggest  using  the  closed  form,  which  contains  a  list  of  possible  items  to  be  selected  or 
blanks  to  be  filled  in  with  words  or  numbers.  (For  an  example  of  a  closed  form  ques¬ 
tionnaire,  see  Appendix  A.)  This  form  has  several  advantages  over  the  other  alternative, 
the  open  form.  It  is  likely  to  take  a  minimum  amount  of  time  to  fill  out,  thus  increasing 
the  chances  that  it  will  be  completed  and  returned.  The  process  of  tabulating  and  sum¬ 
marizing  responses  is  simpler  and  less  time  consuming  than  with  an  open  form  questionnaire. 
Machine  tabulation  and  computer  analysis  of  the  completed  forms  are  practical  when  a 
large  number  of  questionnaires  is  used. 

A  properly  designed  closed  form  questionnaire  is  difficult  to  prepare.  The  designer 
must  be  sure  to  include  all  possible  responses  expected  from  any  of  the  soldiers  who 
will  complete  the  questionnaire.  The  items  must  be  constructed  on  the  form  so  that 
they  clearly  communicate  to  the  user  exactly  what  the  designer  is  trying  to  ask.  The 
greatest  single  problem  with  research  methods  is  improperly  worded  questionnaires,  as  they 
produce  faulty  data.  If  you  intend  to  design  your  own  questionnaires  we  suggest  consult¬ 
ing  the  following  guides: 

Morsh,  J.E.  and  Archer,  W.B.  Procedural  guide  for  conducting  occupational 
surveys  in  the  United  States  Air  Force  (PRL-TR-67-11).  Lackland  Air 
Force  Base,  Texas:  Personnel  Research  Laboratory,  Aerospace  Medical 
Division,  Air  Force  Systems  Command,  September  1967. 

Jacobs,  T.O.  Developing  questionnaire  items:  how  to  do  it  well.  Human 
Resources  Research  Organization  (HumRRO),  300  North  Washington  Street, 
Alexandria,  Virginia  22314. 
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WHAT  SHOULD  BE  INCLUDED  ON  THE  QUESTIONNAIRE? 


The  details  of  the  forms  you  use  will  be  determined  by: 

1.  how  you  will  tabulate  and  summarize  the  results,  and 

2.  what  information  you  wish  to  collect. 

How  you  will  tabulate  and  summarize  results  will  be  determined  by  whether  you 
have  available  a  computer  and  other  automated  data  handling  equipment  and  by  the 
number  of  people  surveyed.  To  determine  what  information  you  wish  to  collect,  you 
should  consider  the  total  data  requirement  for  the  training  development  process.  These 
data  requirements  should  be  predetermined  in  the  job  analysis  plan  so  that  as  much  infor¬ 
mation  as  possible  can  be  obtained  in  a  single  questionnaire  survey  effort. 

One  note  of  caution  about  the  design  of  your  questionnaire  is  that  you  should  keep 
the  questionnaire  as  short  as  practical.  In  general,  the  forms  should  be  designed  so  they 
can  be  completed  in  two  hours  or  less.  One  way  you  can  save  time  on  a  complex 
task  inventory  is  to  list  all  tasks  under  their  appropriate  duty  position  title.  This 
will  permit  the  soldier  to  rapidly  scan  groups  of  tasks  not  performed  and  then  pro¬ 
ceed  to  the  next  duty  position. 


WHAT  TVPE  OF  INSTRUCTIONS  FOR  COMPLETING  AND 
ADMINISTERING  THE  QUESTIONNAIRES  SHOULD  BE  PREPARED? 

After  the  formal  field  survey  questionnaires  have  been  written,  the  instructions  for 
completing  and  administering  the  questionnaires  should  be  prepared.  These  instructions 
should  include: 


•  For  the  user  —  an  introduction  explaining  the  purpose  and 

importance  of  participating  in  the  field  survey. 

—  general  instructions  explaining  how  the  questionnaire 
is  to  be  completed. 


•  For  the  project  officer  —  general  instructions  regarding  responsibilities. 


(When  questionnaire  is  —  specific  instructions  for  administering  the  ques- 
not  self-administered)  tionnaire  in  a  controlled  environment. 


For  examples  of  these  types  of  instructions,  see  Appendix  B. 
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HOOJ  IS  A  SURl/Ey  SAMPLE  SELECTEV? 


You  are  now  ready  to  select  organizations  and  individuals  to  provide  you  with  the 
needed  job  data.  The  complexity  of  the  MOS,  the  availability  and  quality  of  published 
sources  of  job  information,  and  the  number  of  people  in  the  particular  job  will  determine 
how  much  and  what  kinds  of  information  you  need  to  collect.  This  will  strongly 
influence  the  make-up  and  size  of  your  sample.  If  the  complexity  and  amount  of  required 
data  are  great,  the  number  of  organizations  and  individuals  interviewed  will  increase.  As 
a  general  rule,  your  survey  sample  should  be  as  large  as  possible.  This  is  particularly  true 
if  you  do  not  have  personnel  available  with  the  responsibility  and  authority  to  assure  that 
most  of  your  questionnaires  will  be  completed.  You  should  make  an  attempt  to  obtain  a 
sample  that  represents  the  distribution  of  individuals  in  the  MOS  according  to  command 
and  skill  level.  Review  of  personnel  records,  either  by  personnel  employees,  members  of 
your  job  analysis  team,  or  your  field  representatives  who  will  conduct  the  survey  will  be 
required  to  obtain  data  upon  which  to  base  choices  for  your  survey. 

•  In  selecting  UNITS  for  sampling,  you  should  select  units  that: 

1.  have  at  least  a  small  number  of  job  holders  and  supervisors  who  do  the 
particular  job  to  be  analyzed.  Preferably,  you  should  choose  some  units 
that  have  a  relatively  small  number  of  job  holders,  and  some  that  have 
large  numbers. 

2.  are  geographically  and  environmentally  representative. 

•  In  selecting  INDIVIDUALS  within  the  units,  you  should  select  a  group  made  up 
of  individuals  who: 

1.  perform  and  supervise  the  job  being  analyzed 

2.  perform  with  average  satisfactory  proficiency 

3.  are  representative  in  terms  of  length  of  time  on  the  job 

4.  are  representative  in  terms  of  training. 

For  certain  types  of  information  you  will  also  want  to  choose  at  least  a  few  job  holders  or 
supervisors  who  are  acknowledged  experts  at  the  job. 


* 
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HOW  IS  A  QUESTIONNAIRE  SURVEY  CONVUCTEV? 


•  Trial  Run  (Validation  of  Instruments) 

Before  sending  out  the  total  number  of  questionnaires  you  intend  using,  you  may 
wish  to  send  out  a  small  number.  This  will  permit  you  to  check  the  initial  results  and 
possibly  make  some  changes  in  your  questionnaires  or  instructions.  Then  you  will  send 
out  what  you  hope  will  be  the  total  number  of  questionnaires  required. 


•  Group  Administration 

The  ideal  way  to  administer  questionnaires  is  group  administration.  Where  the 
local  responsible  official  and  his  assistants  schedule  the  administration  he  should  do 
the  following: 

—  Make  certain  that  only  eligible  individuals  are  seated  in  the  administration  area 
—  Read  the  administrative  instructions 

—  Provide  any  necessary  assistance  in  completing  the  questionnaires 
—  Return  the  completed  questionnaires  to  the  school 


•  Individual  Administration 

Often,  particularly  with  individuals  at  remote  stations,  group  administration  is 
impractical.  In  these  cases,  it  is  sometimes  effective  to  send  the  questionnaires  to  a 
responsible  officer  and  request  that  they  be  returned  by  a  reasonable  suspense  date. 
Careful  attention  should  be  paid  to  the  instructions  for  administration  or  self- 
administration.  If  your  command  has  no  authority  to  require  that  a  suspense  date 
be  met,  then  you  must  either  obtain  the  concurrence  of  a  command  with  that 
authority,  or  be  willing  to  accept  a  reduced  percentage  return. 


•  Return  of  Questionnaires 

How  much  confidence  can  you  have  in  the  validity  of  your  questionnaire  if  you 
get  less  than  a  100  percent  return?  Less  and  less  confidence  can  be  expected  with  each 
reduction  in  the  percentage  returned.  What  can  you  do  if  you  are  not  satisfied  with  the 
percentage  of  returns  of  the  questionnaires?  We  suggest  you  try  the  following: 

1)  Send  out  more  forms  to  different  people  and  hope  for  better  results. 

2)  Recontact  some  of  the  first  sample  and  try  to  encourage  them  to  return 
the  questionnaires. 

3)  Visit  a  random  sample  of  those  who  did  not  respond  and  compare  their 
forced  responses  with  the  voluntary  responses.  Then  you  and  your  super¬ 
visors  will  have  to  decide  how  much  chance  you  are  willing  to  take  that 
the  data  you  have  received  presents  a  sufficiently  accurate  picture  of  the 
job  as  it  really  exists. 
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PANELS 


WA T  :s  A  PANEL  Of  EXPERTS? 

With  this  method  a  group  of  personnel,  selected  for  their  experience  and  knowledge 
of  the  job,  is  brought  together  to  confer  about  the  required  job  analysis  data.  Panels  may 
be  made  up  of  one  or  more  of  the  following  types  of  members: 

1)  Subject  Matter  Experts  (SMEs) 

These  are  personnel  found  at  your  school  who  are  acknowledged  experts 
in  the  tasks,  duty  positions  or  MOS  you  are  analyzing.  They  may  be 
found  among  instructors  or  ISD  personnel  who  hold  the  MOS.  SMEs 
may  or  may  not  have  had  recent  field  experience. 

2)  Job  Incumbents 

This  group  includes  those  who  are  presently  holding  the  jobs/performing 
the  tasks/  you  are  interested  in,  or  who  have  recently  held  the  jobs.  The 
more  recent  the  better.  More  than  three  years  away  from  the  field  would 
disqualify  a  potential  panel  member. 

3)  Job  Supervisors 

This  group  includes  those  who  are  presently  or  have  recently  (within  the 
past  three  years)  supervised  soldiers  in  the  jobs/tasks  you  are  interested  in. 

Job  incumbents  and  job  supervisors  may  be  found  on  the  post  where  your  school  is 
located  or  at  other  locations.  Check  the  TOEs  and  TOAs  to  find  out  where  personnel 
may  be  assigned.  While  personnel  assigned  to  your  post  are  most  conveniently  assembled, 
they  may  not  be  completely  representative  of  job  incumbents/supervisors  serving  in  other 
locations.  Also,  they  probably  have  been  heavily  burdened  by  school  surveys,  panels,  etc., 
already  due  to  their  proximity  to  the  school.  Therefore,  personnel  from  other  locations 
may  have  to  be  used. 
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WHEN  IS  A  PANEL  USEV? 


Panels  of  experts  are  a  good  alternate  data  source  when: 

—  CODAP  is  not  available 

—  time  and  funds  are  inadequate  for  conducting  a  field  survey 

—  the  type  of  information  required  can  be  reliably  provided  by  a  small  group 


WHEN  APE  SUBJECT  MATTER  EXPERTS  USEV? 

With  this  method,  a  group  of  highly  experienced  personnel  is  brought  together  to 
record  and  organize  the  required  job  analysis  data.  This  method  is  particularly  useful  in 
collecting  job  data  on  new  jobs  or  on  managerial  and  supervisory  jobs  where  many  of 
the  most  critical  behaviors  are  not  directly  observable.  Since  the  members  of  a  panel  of 
SMEs  are  experts  in  the  MOS  being  analyzed,  their  collective  effort  should  be  decisions 
about  the  requirements  of  the  job.  In  general,  their  greatest  effectiveness  is  in  evaluating 
and  making  decisions  about  job  data  that  have  been  collected  from  other  sources  by 
other  means. 


WHEN  ARE  RECENT  JOB  INCUMBENTS  ANV/OR  SUPERVISORS  USEV? 

With  this  method,  a  group  of  job  incumbents,  job  supervisors,  or  a  combination  of 
these,  is  brought  together  to  provide  information  about  their  jobs.  The  primary  function 
of  this  type  of  panel  is  to  provide  information  about  their  jobs,  not  to  make  decisions. 
Another  name  for  this  type  of  panel  is  Consensus  Group. 


HOW  IS  A  PANEL  ASSEMBLEV? 

The  panel  is  a  relatively  inexpensive  and  easy  approach  to  collecting  data.  Three  to 
seven  persons  is  the  number  recommended  to  make  up  the  panel.  Whenever  possible,  you 
want  panel  members  to  be  representative  of  different  locations  and  types  of  units  in  the 
field.  While  many  experts  may  be  available  within  your  school  it  is  critical  that  their 
views  be  balanced  by  those  of  persons  serving  presently  or  recently  in  the  field.  If  all  of 
the  panel  members  come  from  schools,  there  may  be  a  tendency  for  the  outcome  to  reflect 
what  exists  in  training  rather  than  what  actually  exists  on  the  job. 
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Appendix  A 

EXAMPLE  OF  A  CLOSED  FORM  QUESTIONNAIRE 
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JOS  INVENTORY 

(DUTY  TASK  USTl 


mxo/mxo 


P*g«  7  o'  *4  p*jn 


'  0>*e*  t»ki  vow  p«ffofm  now  { 

2.  Add  any  tasks  you  do  now  v*i«ct>  arc  not  listed 

3.  In  th«  'Tim*  Spent"  column,  rate  decked  <^^t»sks  on  time  spent  in  your  present  job 


Tim  Spent  Scale 

\  -  VERY  MuCH«{LOe  SV{RsG£  4  ABOUT  AVERAGE  7 

2  -  BELOW  AVERAGE  5  -  SLIGHTLY  ABOVE  AVERAGE 

3  -  SLIGhTlv  BELOW  AVERAGE  6  -  ABOVE  AVERAGE 


C  FITTING  AND  MAINTAINING  LIFE  RAFTS  AND  PRESERVERS 


7  -  VERY  MUCH  ABOVE 
AVERAGE 


time  spent 
DOING  THESE 
TASKS  IN 
PRESENT  JOB 


1.  Dean  life  praeervers 

42 

2.  Clean  life  rafts 

43 

3.  Condemn  noiwetreii  life  rafts  or  life  prewnmn 


4.  FH  life  preserver* 


6.  Inapect  life  raft 


7.  m^jeet  life  reft* 


t.  Impact  or  weight  teet  cartoon  d*on  Me  ICO?)  cylinders  or  certridger 


9.  Make  entries  on  or  tone*  Ufa  Presenter  Oota  forma  4AFTG  Form  4B61 


10.  MaAe  entries  on  or  roview  Ufa  Preaarsor  Infraction  Data  Record  forma  (AFTQ  Form  336) 


11. 

Make  anmas  on  or  rewow  Ufa  Rah  Infection  Record  forma  IAFTO  Form  337) 

52 

12. 

Mate  omrim  on  or  ww  uw  Canrticonan  uw  l«m  IAFTO  Form  27) 

S3 

13.  Pack  life  praaarvars 


T4.  Peek  lift  reft 


IS.  Pack  Hfe  refti 


16.  Perform  hwownoi  seaa  of  life  pf 


17.  ^rform  functional  tern  of  life  re tn 


16.  Perform  inflation  teats  of  life 


It.  Perform  whet  ion  vets  of  Wfe  rafts 


20.  Perform  minor  capons  to  Ufa 
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Appendix  B 


ADMINISTRATIVE  PROCEDURES 
FOR 

CLOSED  FORM  QUESTIONNAIRE 


1.  Introduction  (for  user  of  questionnaire) 

2.  General  Instructions  (for  user  of  questionnaire) 

3.  General  Instructions  (for  project  officer) 

4.  Specific  Instructions  for  Administering  Questionnaire 
(for  project  officer  wfien  questionnaire  is  administered 
in  a  controlled  environment. 
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TO:  USER  OF  QUESTIONNAIRE 


INTRODUCTION 

TO  THE  NONCOMMISSIONED  OFFICER: 

This  questionnaire  is  part  of  a  field  survey  designed  to  identify  tasks  for  military 
police  training.  Its  specific  purpose  is  to  obtain  from  you,  the  Noncommissioned  Officer, 
information  on  task  criticality  and  frequency  of  performance.  Feedback  gained  from 
this  questionnaire  will  play  a  major  part  in  redesigning  the  Noncommissioned  Officer 
Advanced  Education  System.  The  ultimate  goal  is  to  design  training  so  that  it  reflects 
what  we  have  learned  from  you  in  the  field.  This  goal  is  possible  only  with  your  full 
cooperation.  Consider  each  task  listed  in  this  questionnaire  carefully  and  give  your  best 
response.  Your  contribution  is  essential  to  a  successful  survey. 


TO:  USER  OF  QUESTIONNAIRE 


GENERAL  INSTRUCTIONS 


1.  Complete  this  survey  questionnaire  within  the  time  specified  by  your  unit  project 
officer  and  return  it  to  him  upon  completion. 

2.  Because  instructions  for  completing  each  part  of  this  survey  questionnaire  are 
different,  read  all  instructions  carefully. 

3.  Part  II  requires  that  you  supply  biographical  information.  This  information  will  be 
used  to  correlate  feedback  received  from  the  field.  Print  all  answers  in  the  spaces 
provided  on  the  appropriate  survey  questionnaire  page. 

4.  In  the  upper  right  comer  of  each  page  of  Part  III,  Task  Inventory,  of  this  survey 
questionnaire  is  a  BOOKLET  NUMBER  block.  Immediately  to  the  left  of  this 
block  is  the  individual  booklet  number.  Print  the  individual  booklet  number  in  the 
BOOKLET  NUMBER  block  on  each  page  of  the  Task  Inventory  as  demonstrated  in 
the  example. 


EXAMPLE: 


(000345) 


BOOKLET  NUMBER 

0 

1 

2 

« 

4  5 

6 

7 

8 

9 

0 

1 

2 

3 

m  s 

6 

7 

8 

9 

0 

1 

2 

3 

^  ■ 

6 

7 

8 

9 

5.  Part  III,  Task  Inventory,  is  divided  into  nine  (9)  separate  sections  (Sections  I-IX). 
The  content  of  these  sections  concerns  tasks  you  may  perform  in  your  present  duty 
assignment.  You  are  asked  to  rate  each  task  in  accordance  with  three  criteria  - 
frequency  of  task  performance,  immediacy  of  task  performance,  and  importance  of 
task  to  mission  success. 

Base  all  selections  on  your  experience  in  your  present  duty  assignment. 

a.  Column  A  requires  that  you  rate  how  often  you  perform  each  task  on  a  scale 
from  one  to  four.  The  criterion  for  this  rating  is  the  frequency  of  task  per¬ 
formance.  Those  tasks  performed  most  frequently  will  normally  be  rated  four 
while  those  tasks  not  performed  at  all  will  be  rated  one. 


b.  Column  B  requires  that  you  determine  how  soon  you  must  be  capable  of  per¬ 
forming  each  task  after  reporting  to  your  present  duty  assignment.  The  cri¬ 
terion  for  this  rating  is  the  immediacy  of  task  performance.  Of  the  four 
possible  responses,  select  the  one  most  nearly  describing  your  requirements. 
Select  response  number  four  for  those  tasks  which  you  must  be  capable  of 
performing  immediately  upon  reporting  for  duty.  Select  response  number  one 
for  those  tasks  which  you  never  perform. 

c.  Column  C  requires  that  you  describe,  in  your  opinion,  how  important  each 
task  is  to  mission  success.  The  criterion  for  this  rating  is  the  importance  of 
the  task  to  the  accomplishment  of  the  unit  mission.  Those  tasks  that,  in 
your  opinion,  are  most  important  to  mission  success  will  be  rated  four  while 
those  tasks  that  you  consider  least  important  will  be  rated  one. 

6.  After  selecting,  enter  your  responses  for  each  task,  using  either  a  pen  or  pencil,  in 
the  answer  portion  adjacent  to  the  appropriate  task  statement  as  demonstrated  in 
the  example. 

EXAMPLE:  The  task  PREPARE  CORRESPONDENCE,  if  rated  as  performed 

FREQUENTLY  in  Column  A,  identified  as  must  be  capable  of  performing 
IMMEDIATELY  in  Column  B,  and  determined  by  you  to  be  MOST 
IMPORTANT  in  Column  C,  would  be  entered  in  the  answer  portion,  as 
shown  below. 


PREPARE  CORRESPONDENCE  1 


7.  After  each  section  of  Part  III,  Task  Inventory,  is  a  Write-In  Section.  These  write-in 
sections  are  provided  in  order  that  you  may  comment  on  each  task  inventory  section, 
or  list  any  task(s)  you  think  should  be  included  in  the  Task  Inventory.  These  sections 
also  allow  you  to  comment  on  those  tasks  that  you  find  are  the  most  difficult  for 
you  to  perform. 
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TO:  PROJECT  OFFICER 


GENERAL  INSTRUCTIONS  FOR  PROJECT  OFFICER 


1.  General.  The  Military  Police  School  is  currently  involved  in  redesigning  basic 
military  police  training  to  produce  military  policemen  better  equipped  to  perform 
when  they  reach  the  unit.  The  emphasis  is  toward  training  replacements  in  tasks 
actually  being  performed  in  the  field.  The  questionnaires  in  this  packet  are  designed 
to  identify  those  tasks. 

The  care  with  which  you,  the  project  officer,  administer  the  questionnaires  will 
determine  the  accuracy  of  field  feedback  and,  consequently,  the  success  or  failure 
of  this  project. 

2.  Survey  Packet  Contents. 

a.  Questionnaire 

b.  Supervisor  Questionnaire 

c.  Project  Officer  Instructions 

d.  Answer  Sheets  for  Questionnaire 

e.  Pencils  for  use  cn  answer  sheets. 

3.  Responsibilities. 

a.  Unit  Commander.  The  unit  commander  is  requested  to  appoint  a  project  officer 
and  to  monitor  administration  of  the  survey. 

b.  Project  Officer.  The  project  officer  is  responsible  for  the  control  and  handling 
of  questionnaires,  for  the  administration  of  the  questionnaires,  and  for  returning 
completed  and  unused  questionnaires  to  the  Military  Police  School. 

c.  Questionnaire  Administrator.  The  project  officer  may  appoint  someone  to 
administer  the  questionnaire,  if  necessary.  Normally,  however,  it  is  recom¬ 
mended  that  the  project  officer  administer  the  questionnaire  himself. 

4.  About  the  Questionnaires. 

a.  Questionnaire.  This  questionnaire  is  designed  to  identify  tasks  being  performed 
by  military  policemen  in  the  field  and  the  frequency  with  which  each  task 

is  performed. 

b.  Supervisor  Questionnaire.  The  supervisor  questionnaire  is  programmed  to  pro¬ 
vide  feedback  on  task  criticality,  probability  of  deficient  performance,  and  the 
frequency  with  which  each  task  is  performed. 


5.  Who  Takes  The  Questionnaire.  The  project  officer  is  responsible  for  selecting 
individuals  to  take  the  questionnaires  (respondents)  within  their  units.  Those 
selected  must  meet  the  requirements  listed  below: 

a.  The  questionnaire  respondent  must: 

(1)  Be  in  an  M.P.  duty  assignment  (actually  performing  M.P.  duties) 

(2)  Have  been  on  the  job  at  least  90  days 

b.  The  respondent  to  the  Supervisor  Questionnaire  must: 

(1)  Command  or  supervise  M.P.  personnel 

(2)  Have  been  in  a  command  or  supervisory  position  in  the  unit  for  90  days. 
(Assign  questionnaires  proportionately  among  officers  and  NCO’s.)  . 

6.  Questionnaire  Administration. 

a.  Questionnaire.  The  questionnaire  will  be  administered  in  a  controlled  environ¬ 
ment.  Persons  participating  in  the  survey  will  be  allowed  two  hours  to  complete 
the  questionnaire  and  will  turn  the  questionnaire  and  answer  sheets  in  to  the 
questionnaire  administrator  prior  to  leaving  the  survey  area.  Individual  question¬ 
naires  and  their  accompanying  answer  sheets  will  be  kept  together. 

See  attached  item  for  the  procedure  to  be  followed  in  administering  the 
questionnaire. 

b.  Supervisor  Questionnaire.  Supervisors  selected  as  respondents  for  this  ques¬ 
tionnaire  will  be  allowed  to  sign  for  the  questionnaire  and  take  it  with  them. 
They  will  complete  the  questionnaire  and  return  it  to  the  project  officer  within 
a  time  frame  he  specifies.  This  time  frame  must  be  compatible  with  the 
suspense  date  to  the  Military  Police  School. 

7.  Questionnaire  Handling.  Questionnaires  and  answer  sheets  become  FOR  OFFICIAL 
USE  ONLY  when  completed.  For  ease  of  accounting,  each  questionnaire  and  its 
accompanying  answer  sheets  are  numbered.  All  questionnaires  must  be  returned  to 
the  Military  Police  School  whether  they  are  used  or  not.  Instructions  for  returning 
the  questionnaires  to  the  Military  Police  School  are  contained  in  the  basic  letter. 

If  you  have  any  problems  or  questions,  contact  (NOTE:  Give  name  or  names, 
address,  and  telephone  number). 
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TO:  PROJECT  OFFICER  ADMINISTERING  QUESTIONNAIRE  IN  A  CONTROLLED 
ENVIRONMENT 


ADMINISTERING  THE  QUESTIONNAIRE 

A-l.  Preparation.  A  classroom  or  training  room  equipped  with  desks  will  provide  the 
most  ideal  site  for  administering  the  questionnaire.  Questionnaires,  answer  sheets, 
and  two  electrographic  pencils  should  be  issued  to  participants  after  everyone  who 
is  to  take  the  questionnaire  has  arrived.  This  ensures  that  everyone  starts  together. 

A-2.  Instructions.  The  questionnaire  administrator  will  present  the  following  instructions. 

a.  “Is  there  anyone  here  who  is  not  working  in  an  M.P.  duty  position?  Is  there 
anyone  here  who  has  not  been  assigned  to  their  present  duties  at  least  90  days? 
If  so,  please  leave  at  this  time.” 

b.  “Will  everyone  at  this  time  please  read  the  first  page  in  the  questionnaire  which 
has  been  issued  to  you.” 

(Note  to  the  administrator:  It  must  be  emphasized  that  your  enthusiasm  for 
this  project  or  lack  of  it  will  be  contagious.  It  is  important  that  you  demon¬ 
strate  a  positive  attitude  to  the  participants.  Allow  time  for  the  first  page  to 
be  read  and  underline  the  importance  of  the  questionnaire  with  the  following 
statement.) 

“I  would  like  to  stress  the  importance  of  this  questionnaire.  The  Military 
Police  School  wants  to  design  training  to  fit  the  job  in  the  field.  You  are 
the  only  people  who  can  tell  them  what  they  need  to  know.  Please  think 
through  each  question  and  give  your  best  answers.” 

c.  “Turn  to  Part  I,  Biographical  Information,  and  answer  questions  1-13. 

When  you  have  finished,  lay  your  pencil  on  the  desk  so  I  will  know  when 
to  proceed  to  the  next  step.” 

d.  “Now  read  the  instructions  found  in  Part  II.” 

(Note  to  the  administrator:  Allow  reasonable  time  for  everyone  to  finish  before 
moving  to  the  next  step.) 

“Are  there  any  questions?” 

e.  “As  you  read  in  the  instructions,  there  are  nine  answer  sheets  accompanying 
your  questionnaire.  Take  the  answer  sheets  and  number  them  one  through 
nine  to  correspond  to  the  first  nine  sections  in  Part  III  of  the  questionnaire. 

If  you  do  not  have  nine  answer  sheets,  raise  your  hand— I  have  extra  ones. 

Use  a  separate  answer  sheet  for  each  section.  Answer  only  the  number  of 
questions  listed  in  each  and  move  to  the  next  section  and  answer  sheet.  It 
is  not  necessary  to  write  your  name,  rank,  the  date,  or  course  at  the  top 

of  the  answer  sheet.  Also,  disregard  the  blocks  marked  score,  grade,  extra 
points,  and  social  security  number.” 


f.  “Because  of  the  size  of  this  survey,  these  answer  sheets  will  be  read  by 
machine.  You  must  use  the  special  pencils  provided  so  that  the  machine  can 
read  the  answers.  When  marking  your  answer,  take  care  to  fill  the  vertical 
rectangle  outlining  the  letter  as  shown  by  the  example  on  page  4  of  the 
instructions.  Also,  please  be  sure  not  to  make  any  stray  marks  on  the 
answer  sheets.  Finally,  do  not  fold  the  answer  sheets.” 

g.  “All  answers  must  be  based  on  your  experience  in  this  your  present  unit.  Do 
not  call  on  experience  in  previous  units.  This  means  that  if  you  do  not  per¬ 
form  a  particular  task  in  your  present  unit,  you  must  mark  ‘do  not  perform 
this  task’  on  your  answer  sheet.” 

h.  “You  may  begin  answering  Part  III.  Remember  Section  ten,  the  written 
section.  When  you  finish  answering  all  questions,  insert  your  answer 
sheets  into  the  questionnaire  and  tum  them  in  to  me.  You  may  leave 
when  you  are  finished.  Are  there  any  questions?” 

A-3.  Conclusion.  After  everyone  has  taken  the  questionnaire,  ensure  that  all  ques¬ 
tionnaires  and  answer  sheets  are  accounted  for.  Collect  the  pencils  provided  so 
that  they  may  be  returned  to  the  Military  Police  School  along  with  the  question¬ 
naires  and  answer  sheets. 
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JOB  AID  FOR 

SPECIFYING  LEARNING  EVENTS/ACTIVITIES 

ISD  111.1 
Manual 


This  is  the  9th  in  a  series  of  ISD  Job  Aids  for  use  in  instructional  design  and 
development.  This  volume  is  to  be  used  as  a  supplement  to  the  primary  document, 
“Job  Aids:  Descriptive  Authoring  Flowcharts  ISD  III.l  Specify  Learning  Events/ 
Activities.”  The  flowchart  document  will  direct  you  to  specific  guidance,  examples, 
and  references  provided  in  this  volume.  If  you  do  not  have  the  primary  flowchart 
document,  request  it  from  your  supervisor. 


The  wording  in  this  manual  should  not  be  construed  to 
discriminate  between  the  sexes.  In  order  to  avoid  a 
repetitious  use  of  the  terminology,  "he/she,"  the  terms, 
"he,"  "him,"  and  "his,"  as  well  as  "men,"  are  intended 
to  include  both  the  masculine  and  feminine  gender.  Any 
exceptions  to  this  usage  will  be  so  noted. 
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What  is  the,  Leasming  Activities  Job  Aid.  Alt  About? 

•  OBJECTIVE 

1.  Given  a  list  of  tasks  selected  for  training,  and  a  list  of  learning  objectives 
for  the  task  elements/enabling  skills  and  knowledges  for  each  task  select  the 
most  appropriate  learning  activities  for  training  the  learning  objectives. 

2.  Given  an  appropriate  worksheet  (Learning  Activities  Recording  Sheet),  and 
instructions  on  how  to  fill  it  out  correctly,  fill  out  a  worksheet  for  each 
critical  task. 


•  PURPOSE 

The  purpose  of  this  job  aid  is  to  help  you  select  appropriate  learning  events  and 
activities  for  training  sessions  in  which  critical  tasks  will  be  taught.  Learning 
research  has  identified  learning  activities  and  conditions  which  are  essential  for 
teaching  different  kinds  of  learning  objectives.  In  this  job  aid,  you  will  learn 
what  those  activities  and  conditions  are. 


•  PRODUCT 

This  Job  Aid  will  result  in  a  listing  of  learning  activities  for  teaching  the  learning 
objectives  for  each  critical  task. 


DESCRIPTIVE  FLOWCHART 


The  flowchart  on  pages  1-43  thru  1-44  shows  the  major  steps  in  the  use  of  the 
Job  Aid  for  specifying  Learning  Activities  for  all  learning  objectives  in  critical 
tasks.  The  flowchart  will  be  useful  to  you  in  getting  a  clear  picture  of  the  over¬ 
all  process  used  in  this  job  aid.  A  more  completely  described  flowchart  is  pro¬ 
vided  in  Job  Aids:  Descriptive  Authoring  Flowcharts. 


OVERVIEW  OF  MAJOR  STEPS  IN  SPECIFYING  LEARNING  ACTIVITIES 

The  following  major  steps  are  performed  for  each  critical  task  element/enabling 
skills  and  knowledges  that  is  to  be  included  in  training:  (i.e.,  those  for  which 
there  is  a  Learning  Objective.) 

Step  1.  The  learning  category  (Mental,  Physical,  or  Attitudinal)  is  identified 
and  recorded  for  each  Learning  Objective. 

Step  2.  The  learning  subcategory  is  identified  and  recorded  for  each  Learning 
Objective. 

Step  3.  Based  on  the  learning  category  and  subcategory,  appropriate  learning 
activities  for  teaching  each  Learning  Objective  are  specified  and 
recorded. 


WORKSHEET  USED 

—  The  Table  on  the  next  page  shows  a  sample  of  a  completed  Learning  Activities 
Recording  Sheet  (LAR). 


EXAMPLE 


fro'-  block  8 


r'  "4  - 

Obtain  Fust  Ned 

" 

Leat rung  Activities 

Recording  Sheet 

(LAR  Sheet) 

L  - 

to  block  10 


•  learning  Objectives  tor  each  critical  task  an  classified  by  learning  category  and 
sub  category  Appropriate  learning  activities  are  then  specified  lor  cadi  Learning 
Ohjec five  The  (earning  Activities  flee y  •  ng  Sheets  1LAR)  are  used  to  record 
these  (lata 

•  F  r  guidance  m  obtaining  LAR  Sheets,  see  below 


(nlheAe  do  1  get  LeaAntng  AetivttUe*  Re.cosicU.ng  Sheet*  ( LAR )? 

•  A  Learning  Activities  Recording  Sheet  (LAR)  is  available  for  duplication  in 
the  pocket  at  the  end  of  this  manual. 

•  To  see  a  sample  of  a  completed  LAR  Sheet  refer  to  page  1-6. 


from  block  9 


Complete  Section  1  ul 

LAR  Sheet 

It 

Complete  Section  il  ot 

LAR  Sheet 

to  block  12 


•  Information  required  >n  Sec  Min  I  <jt  me  L  AR  Sheet  >s 

Name  Olke  Symt:ri 
Date 

Course  under  development 
MOS  okill  Level 

•  Example  See  below 


•  tntoi motion  required  m  Section  II  o<  the  LAR  Sheet  is 

Task  ID  No 

Terminal  Learning  Objective  (Action  Statement  Only) 

•  Example  See  below 


What  Voqj>  the.  Learning  kcJUviU Let>  Re.cox.cUng  Sheet  (LAR) 
Look  Ltke  When  Section  I  and  II  Have  Been  Completed? 

EXAMPLE: 

ISD  IIX1  Specify  Learning  Events/ Activities 


LEARNING  ACTIVITIES  RECORDING  SHEET 


1.9 


1 


1 


Hou)  do  I  I denting  and  Record  the  RiAAt/Mext  Le.an.ntng 
Obje.ati.ve.  [LO)  {, on.  Thti,  Cnttical  Ta&k? 

This  block  represents  the  first  step  in  the  completion  of  Section  III  of  this  LAR 
Sheet.  Perform  the  following: 


(1)  Examine  the  LOs  associated  with  this  critical  task. 

(2)  Identify  the  first/next  LO. 

(3)  In  Column  A  of  the  LAR  Sheet,  record  only  the  action  statement  for 
the  first/next  LO. 

What  VoeA  the  LAR  Sheet  Look  Like  A^tex  the  Btxt>t/UexX 
Leanntng  Objective  Action  Statement  Hoa  Been  Recorded? 

EXAMPLE: 

ISD  III  1  Specify  Learning  Events/ Activities 

LEARNING  ACTIVITIES  RECORDING  SHEET 


{LAR  ShMt) 


$ 


from  block  12 


to  block  15 


bJkcut  a/iz  thz  C hoAa.cX.2Xii> £icJ>  o{>  thz  Th/izz  LzaA.yu.ng  CcutzgoAlzb? 

All  Learning  Objectives  fall  into  one  of  three  learning  categories— MENTAL,  PHY¬ 
SICAL,  or  ATTITUDINAL.  The  characteristics  of  each  of  these  categories  are: 

MENTAL:  The  learning  required  for  learning  objectives  categorized  as 

“mental”  is  mainly  intellectual,  involving  the  mind.  Learning 
how  to  make  decisions,  memorizing  of  information,  are  exam¬ 
ples  of  chiefly  mental  learning  tasks. 

PHYSICAL:  Learning  of  objectives  categorized  as  “physical”  involves  much 
use  of  parts  of  the  body  for  accomplishment.  Mental  processes 
are  always  involved,  but  the  emphasis  is  on  skill  in  use  of  the 
body.  Learning  to  use  a  tool  or  to  play  a  sport  are  examples 
of  learning  tasks  which  would  be  classified  as  physical. 

ATTUDINAL:  Typically,  learning  objectives  categorized  as  “attitudinal” 

involve  learning  to  choose  to  perform  one  type  of  behavior 
instead  of  another,  less-desirable  kind.  Learning  to  obey  orders, 
or  to  observe  safety  regulations  are  learning  tasks  that  would 
fall  into  the  attitudinal  category. 


>5 


from  block  14 


Oeteimine/  Record 

Lae/nwg  Category 
1  Col.  B,  £«tion  ill. 
IAR  Sheet  I 


One  o<  the  following  three  learning  categories  is  recorded  m  Col  B  ol  the 
LAB  Sheet 

-  MENTAL 
PHYSICAL 

-  ATTITUDINAI 

For  further  guidance  in  determining  and  recording  appropriate  learning 
category,  tee  below. 


to  block  1 6 


How  do  l  Vntumint  the.  LnaAning  Cat&goay  Tkout  SkouJLd  be. 

A signed  -to  Tkl6  Lqjvi wing  Objective? 

•  Assign  the  learning  objective  to  one  of  the  following  three  learning  categories: 

—  Mental 
—  Physical 
—  Attitudinal 

•  The  learning  category  may  already  be  available  as  output  from  previous  ISD 
blocks  (e.g.,  ISD  II. 1  Develop  Objectives).  If  so,  review  the  previously  assigned 
learning  category  to  be  certain  that  it  is  correct.  If  you  disagree  with  the  cate¬ 
gory  already  assigned  be  certain  that  you  coordinate  with  the  individual!  s)  who 
made  the  initial  category  assignment.  Together  you  should  be  able  to  arrive 

at  the  appropriate  learning  category  for  this  objective. 

•  If  you  need  assistance  in  determining  the  appropriate  learning  category  to  assign, 
refer  to  Manual,  page  1-11. 


How  and  WkeAz  do  I  Rzcoad  the  Lea/inlng  Category  on. 
ThjJ>  LoxuiYiing  Obj&dtivz? 

•  The  learning  category  is  recorded  in  Column  B,  Section  III  of  the  LAR  Sheet 
opposite  the  action  statement  of  the  learning  objective. 


•  The  MENTAL  learning  category  Sobdi v«dc*d 
miu  **»  subcaiego'iei  They  ate 

identifying  obiects  and  symbols 
■etalimg  information 
d<sui(Tii«attMg 
Classifying 

rule  learning  and  using 
deiiyinn  making 

•  fut  examples  of  eaih  suptalegniy  see  belli* 


How  do  1  Vetenmtne  the  Lexmning  SubcxLte.gon.ij  ^on.  Lecm.yu.ng 
Objectives  Ccutegontzed  as  Mentat? 

•  There  are  six  learning  subcategories  associated  with  the  MENTAL  learning  category. 
They  are: 

—  identifying  objects  and  symbols 

—  recalling  information 

—  discriminating 

—  classifying 

—  rule-learning  and  using 

—  decision-making 

•  Table  1-15  (page  1-15)  provides  definitions  for  each  of  the  learning  subcategories. 
The  Table  also  provides  examples  of  action  verbs  and  learning  skills  commonly 
associated  with  learning  objectives  that  fall  into  the  various  learning  subcategories. 
Study  the  table  carefully. 

•  After  studying  Table  1-15  you  should  have  little  difficulty  in  assigning  your  learn¬ 
ing  objectives  to  a  subcategory.  If  you  need  help  in  making  a  decision,  match 
the  verbs  in  the  learning  objective  to  the  Action  Verbs  in  the  table  or  try  to  find 
an  example  that  would  fit  your  learning  objective.  If  you  find  yourself  completely 
unable  to  fit  a  learning  objective  into  any  of  the  given  subcategories,  the  objec¬ 
tive  may  be  incorrectly  written.  You  may  need  to  refine  and  rewrite  it  before 

it  can  be  successfully  assigned  to  one  of  the  learning  subcategories.  If  such  is  the 
case,  be  certain  to  coordinate  with  the  individual  who  originally  prepared  the 
learning  objective  BEFORE  YOU  MAKE  ANY  CHANGES  TO  THE  LEARNING 
OBJECTIVE. 


MENTAL  LEARNING  CATEGORY 

Definitions  and  Examples  of  Learning  Subcategories 


LEARNING  SUBCATEGORY 


Identifying  objects  and  symbols 


Recalling  information 


Discriminating 


Classifying 


Rule  learning  and  using 


Decision  making 


DEFINITION 
OF  SUBCATEGORY 

To  give  one  unvarying  response 
whenever  a  particular  object 
symbol  is  presented 


To  repeat  memorized  informa 
tion  orally  or  in  writing 


When  presented  with  items 
that  appear  to  be  similar,  to 
identify  the  differences 
between  them 


When  presented  with  items 
that  appear  to  be  different, 
to  identify  the  features  which 
they  have  in  common 


To  state  when  and  how  a 
principle  applies  to  a  given 
situation 


To  specify  a  course  of  action 
for  use  m  a  problem  stguation 


COMMON 
ACTION  VERBS 

Identify 

Interpret 

Read 


Monitor 

Distinguish 

Detect 

Discriminate 


Identify 

Recognize 

Classify 


Select 

Predict 

Determine 

Specify 

Apply 


Choose 

Decide 

Formulate 

Select 

Evaluate 


Reading  map  symbols 

Reading  electronic  symbols  on  a 
schematic 

Giving  names  of  components  of  an 
engine  when  shown  engine  or  diagram 


Recalling  radio  frequencies 
Recalling  rules  of  protocol 
Stating  Ohm's  law 
Recalling  SALUTE  acronym 

Distinguishing  between  sound  of 
normally-functioning  power  generator 
and  sound  of  one  in  which  a  bearing 
is  beginning  to  burn  out 

Distinguishing  between  ranks  of 
officers  by  stripes 

Identifying  all  aircraft  which  are 
U.S.  aircraft 

Identilying  problem  situations  in 
which  a  soldier  is  free  to  make  a 
decision  on  his  own  without  con 
suiting  a  supervisor 

Knowing  when  to  salute 
Solving  algebra  problems 
Making  verbs  agree  with  their  subjects 

Selecting  proper  fire  extinguisher  for 
different  types  of  fire 

Troubleshooting  malfunctioning 
equipment 

Choosing  tactics  in  combat 

Choosing  torpedo  setting  during  a 
torpedo  attack 


'AAbiL.-  - ,  'h 
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from  block  1 6 


to  block  21 


from  block  1  7 

;  i 

0«fer  mine. Record 

Appiupnaie  learning 
Aiiivitm 

|  Coi  C  Set  lion  III 
LAR  Sh-^ll 


to  olock  19 


•  learning  Activities  necessary  lot  leaching  the 
learning  objetuves  associated  with  each  ot  the 
si*  subvaiegoi.es  of  the  MENTAL  Learning 
Category  are  prepared  and  rec  .tded  on  the  lAH 

•  Ear  further  guidance  <n  preparing  and  recording 
appiupnate  learning  activities,  see  below 


How  do  I  Identify  Appnopniate.  Le.aA.ning  Activities  £oa 
Tracking  Le.aA.ning  Objectives  Cate.goAtze.d  as  Being  Me.ntal  Skittb? 

•  For  each  of  the  learning  subcategories  within  the  Mental  Skill  category  there  is 

a  set  of  learning  activities  which  must  be  used  for  teaching  successfully  all  learn¬ 
ing  objectives  belonging  to  that  subcategory.  The  learning  activities  differ  for 
the  various  subcategories.  For  example,  the  best  method  of  teaching  identifica¬ 
tion  of  objects  is  completely  different  from  the  best  method  of  teaching  decision¬ 
making. 

•  Fortunately,  education  research  has  developed  guidelines  for  the  development  of 
learning  activities  for  each  of  the  six  subcategories.  The  six  subcategories  are 
shown  on  pages  1-19  thru  1-24.  For  each  subcategory  you  will  find  the  following 
information: 

—  The  learning  activities  that  must  be  featured  (or  emphasized)  to  train  the 
objective  falling  into  that  subcategory. 

—  An  example  of  a  characteristic  learning  objective  falling  under  the  subcategory. 

—  Guidelines  useful  for  developing  appropriate  learning  activities. 

—  Example  of  appropriate  learning  activities  for  the  learning  objective  used  as 
an  example. 

•  To  identify  the  appropriate  learning  activities  for  teaching  a  learning  objective, 
here  is  what  you  should  do: 

(1)  Look  at  the  subcategory  for  the  learning  objective  under  consideration 
(Column  B,  Section  III,  LAR  Sheet). 

(2)  Turn  to  the  page  in  the  Manual  (pages  1-19  —  1-24)  that  contains  guidelines 
and  examples  for  developing  learning  activities. 

(3)  Relate  the  learning  guidelines  shown  on  that  page  to  your  learning 
objective. 

(4)  Develop  learning  activities  specific  to  your  learning  objective. 

•  Record  the  appropriate  learning  activities  for  training  the  learning  objective  for 
Column  C,  Section  III,  LAR  Sheet. 
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IDENTIFYING  OBJECTS  AND  SYMBOLS 


LEARNING  ACTIVITIES  MUST  FEATURE:  a  constant  pairing  and  association  between  the 

objects/symbols  and  their  names/meanings. 

EXAMPLE  OF  LEARNING  OBJECTIVE:  The  soldier  will  state  the  meainings  of  five  terrain 

symbols  found  on  military  maps. 


Guidelines  for  Determining 

Appropriate  Learning  Activities 

Examples  of  Appropriate 

Learning  Activities 

1. 

Present  each  object/symbol  and  simultaneously 
state  its  name  or  meaning. 

1. 

Present  drawing  of  each  of  five  map  symbols 
and  simultaneously  state  what  each  stands  for. 

2. 

Present  each  object/symbol  and  ask  trainee  to 
give  its  name  or  meaning.  Give  immediate 
feedback  on  responses. 

2. 

Present  each  of  five  map  symbols  (in  any 
sequence)  and  ask  the  trainee  to  state  what  each 
stands  for.  Tell  trainee  immediately  whether  his 
responses  were  right  or  wrong. 

3. 

Repeat  step  2  until  trainee  can  giv.  all 
names/meaning  correctly  and  quickly. 

3. 

Repeat  step  2  unti1  the  trainee  can  correctly 
state  what  each  of  the  five  symbols  stands  for. 
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RECALLING  INFORMATION 


LEARNING  ACTIVITIES  MUST  FEATURE:  the  use  of  patterns  for  organizing  the  information 

to  be  recalled,  and  testing  of  the  trainee's  ability 
to  recall  information  without  prompting. 


EXAMPLE  OF  LEARNING  OBJECTIVE:  The  soldier  will  list  the  kinds  of  information 

concerning  aggressor  personnel  which  should  be 
reported  to  his  superiors. 


Guidelines  for  Determining 
Appropriate  Learning  Activities 


1.  Where  possible,  organize  information  to  be 
learned  into  a  meaningful  pattern. 


2.  Let  trainee  memorize  each  section  of  informa¬ 
tion  until  the  whole  has  been  memorized. 

3.  Test  trainee's  ability  to  recall/recite  the  in¬ 
formation.  Give  prompts  and  cues  at  first, 
then  withdraw  these.  Give  immediate  feed¬ 
back  on  accuracy  of  responses. 

4.  Repeat  step  3  until  trainee  can  recite/give 
information  correctly. 


Examples  of  Appropriate 
Learning  Activities 


1.  Organize  information  to  be  reported  on  con¬ 
cerning  aggressor  personnel  into  a  meaningful 
pattern,  (e.g.  SALUTE  -  (acronym): 

S-izc 
A— ctivity 
L— ocation 
U— nit 
T— ime 
E— quipment 

2.  Let  trainee  memorize  each  of  the  above  six 
items  until  whole  has  been  memorized. 

3.  Test  trainee's  ability  to  recite  the  above  informa¬ 
tion.  Give  prompts  at  first,  then  withdraw  these 
completely.  Tell  trainee  immediately  whether 
and  where  he  was  tight  or  wrong. 

4.  Repeat  step  3  until  trainee  can  accurately  recall 
information  concerning  aggressor  personnel. 
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DISCRIMINATING 


LEARNING  ACTIVITIES  MUST  FEATURE:  a  side  by -side  comparison  of  the  items  to  be 

discriminated,  including  pointing  out  i  le  ways 
in  which  they  differ;  and  practice  by  the  trainee 
in  making  discriminations. 


EXAMPLE  OF  LEARNING  OBJECTIVE:  The  soldier  will  distinguish  between  a  severe 

burn  and  a  minor  burn. 


Guidelines  for  Determining 
Appropriate  Learning  Activities 


1.  Present  apparently  similar  items  side-by-side. 
Point  out  the  differences  bewecen  them. 


2.  Present  examples  of  apparently  similar  items. 
Ask  learner  to  distinguish  between  them.  Give 
immediate  feedback  on  trainee's  responses. 

3.  Repeat  step  2  until  trainee  can  make  discrimina¬ 
tions  with  accurance  and  ease. 


Examples  of  Appropriate 
Learning  Activities 


1.  Present  color  photographs  of  a  severe  burn  and 
a  minor  burn  side  by  side.  Point  out  that  the 
skin  is  charred  or  blistered  over  a  large  area  in  a 
severe  burn,  while  the  skin  is  neither  blistered 
nor  charred  (or  is  blistered  over  a  small  area 
Only)  in  a  minor  burn. 

2.  Present  other  color  photographs  of  both  severe 
and  minor  burns.  Ask  the  trainee  to  distinguish 
between  them.  Tell  the  trainee  at  once  whether 
his  responses  were  correct  or  incorrect. 

3.  Repeat  step  2  until  trainee  can  correctly  distin¬ 
guish  between  both  types  of  burns. 
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CLASSIFYING 


LEARNING  ACTIVITIES  MUST  FEATURE: 


EXAMPLE  OF  LEARNING  OBJECTIVE: 


a  side-by-side  comparison  of  the  items  to  be  classified 
including  pointing  out  ways  in  which  they  are  alike: 
providing  the  trainee  with  a  descriptive  definition  of 
the  class  being  studied;  and  practice  by  the  trainee  in 
classifying. 

The  soldier  will  recognize  all  aircraft  belonging  to  the 
United  States. 


Guidelines  for  Determining 
Appropriate  Learning  Activities 


Examples  of  Appropriate 
Learning  Activities 


Present  apparently  different  items  side  by  side. 
Point  out  the  features  they  have  in  common 
(similarities). 

Formulate  a  definition  of  the  class  based  on  the 
observed  similarities. 

Present  items  which  belong  to  the  class  as  well 
as  items  which  do  not.  Ask  the  trainee  to 
identify  those  items  which  belong  to  the  class. 
Give  feedback  on  the  accuracy  of  the  trainee's 
response. 

Repeat  step  3  until  trainee  can  accurately 
classify  items. 


1.  Present  color  photographs  of  different  U.S.  air¬ 
craft  side  by  side.  Point  out  the  marking'  and 
other  features  that  identify  them  as  belonging 
to  the  U.S. 

2.  Formulate  a  definition  of  the  class  —  e.g.,  all 
U.S.  aircraft  have  markings  that  look  like  this. 

3.  Present  color  photographs  of  various  U.S.  air¬ 
craft,  USSR  aircraft,  and  Chinese  aircraft.  Ask 
the  trainee  to  pick  out  the  U.S.  aircraft.  Tell 
trainee  at  once  whether  he  is  correct  or 
incorrect. 

4.  Repeat  step  3  until  trainee  can  correctly  identify 
all  aircraft  belonging  to  the  U.S. 
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RULE-LEARNING  AND  USING 


LEARNING  ACTIVITIES  MUST  FEATURE:  an  explanation  of  the  rule  and  practice  in  applying  it. 

EXAMPLE  OF  LEARNING  OBJECTIVE:  The  soldier  will  challenge  all  personnel  attempting  to 

enter  his  sector  and  will  allow  to  enter  only  those  giving 
the  correct  password. 


Guidelines  for  Determining 
Appropriate  Learning  Activities 


1.  Present  and  explain  the  rule. 


2.  Present  a  situation(s)  in  which  the  rule  applies 
and  show  how  it  applies.  Also,  present  a 
situation (s)  in  which  the  rule  does  not  apply, 
for  contrast. 

3.  Present  a  variety  of  situations,  some  requiring 
application  of  the  rule  and  some  not.  Ask  the 
trainee  to  identify  those  in  which  the  rule 
applies  and  to  state  how  it  applies.  Give 
immediate  feedback  on  accuracy  of  trainee's 
responses. 

4.  Repeat  step  4  until  most  or  all  tiainee  responses 
are  correct. 


Examples  of  Appropriate 
Learning  Activities 


1.  Explain  the  rule  -  only  those  giving  current 
password  are  to  be  allowed  to  enter.  Explain 
procedure  for  requesting  password  - 

say  "Halt!" 

'cover'  stranger 

Ask  "Who  is  there?",  etc. 

2.  Present  situation  where  rule  applies  le.g.  in  de¬ 
fensive  position  within  designated  sector  of  fire). 
Name  situation  (e.g.,  in  barracks  or  dining 
facility)  where  rule  does  not  apply. 

3.  Present  a  variety  of  situations  and  ask  the 
trainee  if  and  how  the  rule  about  challenging 
strangers  applies  -  e.g.,  does  it  apply  in  the 
theater,  outside  militarized  zone,  in  the  motoi 
pool,  etc.  Tell  trainee  if  his  responses  are 
correct  or  incorrect  and  give  reason  for  each. 

4.  Repeat  step  3  until  the  trainee  can  correctly 
challenge  a  stranger  most  of  the  time. 
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DECISION-MAKING 


LEARNING  ACTIVITIES  MUST  FEATURE:  demonstration  and  practice  in  the  identification  of  the 

decision  needed,  collection  of  relevant  data  and  selection 
of  best  possible  solution. 

EXAMPLE  OF  LEARNING  OBJECTIVE:  The  soldier  will  select  the  next  position  to  which  to 

move  in  the  field  under  combat  conditions. 


Guidelines  for  Determining 
Appropriate  Learning  Activities 

Demonstrate  the  following  procedural  steps:  1. 

(a)  identification  of  decision  needed 

(b)  collection  of  relevant  data 

(c)  formulation/identification  of  a  number 
of  possible  solutions 

(d)  evaluation  of  each  solution 

(e)  selection  of  the  one  best  solution 


Present  a  number  of  problem  situations.  Ask  2. 

the  trainee  to  apply  the  procedural  steps  in 
order  to  make  a  decision  about  the  problem 
situation.  Give  immediate  feedback  on  the 
adequacy  of  the  trainee's  performance  of  task. 


Repeat  step  2  until  trainee  generates  adequate  3. 
decisions  in  most  problem  situations. 


Examples  of  Appropriate 
Learning  Activities 

Demonstration  by  the  instructor  of  the  following 
proceduial  steps  for  determining  the  one  best 
next  position  to  move  to  in  a  combat  situation: 

(a)  identification  of  decision  needed  -  choice 
of  next  position 

(b)  collection  of  relevant  data  on  terrain, 
distance,  visibility,  position  of  aggressor 
sniper,  etc. 

(c)  identification  of  at  least  2  alternative  field 
positions 

(d)  selection  of  the  best  position  to  move  to 

Present  trainee  with  a  number  of  situations  in 
which  he  has  to  choose  the  next  position  to 
which  to  move.  Ask  trainee  to  make  a  choice 
by  applying  the  procedural  steps  which  were 
demonstrated  by  the  instructor.  Tell  trainee  at 
once  whether  his  choices  were  good  or  poor. 

Give  reasons. 

Let  trainee  practice  process  of  choosing  positions 
and  receiving  feedback  on  his  choices  until 
trainee  can  select  good  positions  consistently, 
within  a  stated  time  limit. 


from  block  16 


to  olock  26  to  block  23 


How  do  I  Vztznjninz  tkz  Lza/uting  Su.bcatzgon.ij  &on 
Lzanntng  ObjzctLvzA  Catzgontzzd  ai>  PktjAtcal? 

•  There  are  two  learning  .subeategories  associated  with  the  PHYSICAL  learning  category 
They  are: 

—  gross  motor  skill 

—  responsive  motor  skill 

•  Table  1-26  provides  definitions  for  the  two  learning  subcategories.  The  table  also  pro¬ 
vides  examples  of  action  verbs  and  learning  skills  commonly  associated  with  learning 
objectives  that  fall  into  the  learning  subcategories.  Study  the  table  carefully. 

Table  126 

PHYSICAL  LEARNING  CATEGORY 


Definitions  and  Examples  of  Learning  Subeategories 


LEARNING  SUBCATEGORY 

definition 

OF  SUBCATEGORY 

COMMON 
ACTION  VERBS 

EXAMPl  E S 

Gross  motor  skill 

To  move  all  or  parts  ol  the 
body  in  order  to  perform  a 
set  action. 

Cut 

Weld 

Saw 

Drill 

Splice 

Draw 

Using  a  drill 

Painting  a  ship's  hull 

Load"ig  a  gun 

Responsive  motor  skill 

To  move  all  or  parts  uf  the 
body  in  response  to  con 
timially  changing  cues  to 
action. 

Track 

Control 

Steer 

Guide 

Driving  cai  along  load 

An  to  an  gunnery  target  tracking 

Holding  a  course  with  a  gyro  or 

R  Ctju  l  d  in 

•  After  studying  Table  1-26  you  should  have  little  difficulty  in  assigning  your  learning 
objective  to  a  subcategory.  If  you  need  help  in  making  a  decision,  match  the  verbs  in 
the  learning  objective  to  the  Action  Verbs  in  the  table  or  try  to  find  an  example  that 
would  fit  your  learning  objective.  If  you  find  yourself  completely  unable  to  fit  a  learn 
ing  objective  into  either  of  the  two  subcategories,  the  objective  may  be  incorrectly 
written.  You  may  need  to  refine  and  rewrite  it  before  it  can  be  successfully  assigned 
to  one  of  tlie  learning  categories.  If  stu  b  is  the  case,  be  certain  to  coordinate  with  the 
individual  who  originally  prepared  the  learning  objective  REFORE  YOU  MAKE  ANY 
CHANGES  TO  THE  LEARNING  OBJECTIVE 
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Hew  and  WkeAe  do  l  RccoAd  tke.  Le.aAnd.ng  SubcategoAy? 

•  The  learning  subcategory  is  recorded  in  Section  III,  Column  B.  See  below  for  an 
example  of  how  it  looks  after  it  has  been  recorded. 


{tikaZ  dou  the.  LAR  SkceX  Look  Like,  A fateA  Ike. 
Leaning  Sabca.te.goAy  Haj,  Been  RccoAd&d? 


EXAMPLE: 


ISD  III  1  Specify  Learning  Events/Activities 


LEARNING  ACTIVITIES  RECORDING  SHEET 


(LAR  ShMt) 
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Holv  do  I  I dQutdfatj  Appn.opnd.<ztQ.  Lqcuuvuiq  A cXd.odJu.QJ>  fa on. 
To.achd.ng  Lcccnndug  ObjccddooM  CoutQ.gondzo.d  cu  Bodng 
Plupdcad.  SkitLs? 

•  There  is  an  individual  set  of  learning  activities  which  must  be  used  for  success¬ 
fully  teaching  learning  objectives  belonging  to  each  of  the  two  subcategories 
under  the  PHYSICAL  Learning  Category.  Guidelines  for  developing  the  learning 
activities  are  provided  on  the  pages  shown  below: 

—  Gross  Motor  Skill  —  Page  1-30. 

Responsive  Motor  Skill  -  Page  1-31. 

•  To  identify  the  appropriate  learning  activities  for  teaching  a  learning  objective 
categorized  into  one  of  the  two  physical  subcategories  do  the  following: 

(1)  Look  at  the  subcategory  for  the  learning  objective  under  consideration. 
(Column  B,  Section  III,  LAR  Sheet). 

(2)  Turn  to  the  page  in  the  Manual  (Page  1-30  or  Page  1-31)  that  contains 
guidelines  and  examples  for  developing  learning  activities  for  that 
suhcategory. 

(3)  Relate  the  learning  guidelines  shown  on  that  page  to  your  learning 
objective. 

(  4)  Develop  learning  activities  specific  to  your  learning  objective. 

•  Record  the  appropriate  learning  activities  for  training  tiie  learning  objective  in 
Column  C,  Section  III,  LAR  Sheet. 
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GROSS  MOTOR  SKILL 


LEARNING  ACTIVITIES  MUST  FEATURE'.  a  demonstration  of,  and  opportunity  to  practice,  the 

whole  task/skill. 


EXAMPLE  OF  LEARNING  OBJECTIVE: 


The  soldier  will  load  an  M16A1  rifle. 


Guidelines  for  Determining 

Appropriate  Learning  Activities 

Examples  of  Appropriate 

Learning  Activities 

1. 

Demonstrate  performance  of  the  whole  task. 

(If  task  is  complex  or  lengthy,  break  into 
parts,  and  demonstrate  each  part  separately 
at  fir st  1. 

1. 

Demonstrate  steps  in  loading  the  rifle: 
locate  cartridges 
insert  cartridges  m  magazine 

2. 

Let  trainee  practice  performing  whole  task. 

(or  practice  performing  parts  of  task  separately 
at  first).  Give'provide  immediate  feedback  on 
accuracy  and  adequacy  of  trainee's  performance 
of  task. 

2. 

Let  tiamee  practice  steps  it.  the  task.  Tell  him 
at  once  whethei  he  loaded  the  rifle  correctly. 

3. 

Repeat  step  2  until  trainee  can  perform  task 
well  and  as  quickly  as  required. 

3. 

(If  necessary),  have  tr:  nee  repeat  process  until 
he  can  do  it  within  the  tated  time  limit  and 
can  pe  form  it  accurat-  ,y. 
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RESPONSIVE  MOTOR  SK 


LEARNING  ACTIVITIES  MUST  FEATURE:  a  demonstration  of  the  skiil/task  by  the  instructor  and 

trainee  practice  in  performing  the  skill/task .  including 
use  of  senses  to  detect  clues  to  changing  performance. 

EXAMPLE  OF  LEARNING  OBJECTIVE:  The  soldier  will  drive  a  utility  truck,  1  ■  4  ton,  M151.A1 

cross  country. 


Guidelines  for  Determining 

Appropriate  Learning  Activities 

Examples  of  Appropriate 

Learning  Activities 

1.  Demonstrate  whole  task,  pointing  out  cues 

that  initiate  and  end  performance  of  each 
step  in  task. 

1.  Demonstrate  driving  the  truck,  pointing  out  cues 

that  influence  action,  such  as: 

-  speedometer 

-  road  signs 

-  curves  in  road 

-  trees  and  other  roadside  tenant 

-  lane  markings 

2.  Let  trainee  practice  performing  task,  using  his 

senses  to  receive  feedback  on  his  petformance. 

2.  Lot  trainee  practice  driving  the  tiuck,  using  Ins 

five  senses  to  detec;  cues  that  influence  the 
action  of  driving  (see  above*.  Trainee  must 
manipulate  the  controls  of  the  truck  in  response 
to  such  cues. 

3.  Retreat  step  2  until  trainee  can  perform  task 

well  and  as  quickly  as  required 

3.  Let  trainee  practice  driving  the  tiuck  cross 

country  until  he  becomes  piofic.ciit  at  doing  so 
accurately  and  safely. 
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Hoic  do  I  VeteMjnine  the  Leaguing  Subcategorg  faon. 

Learning  Objective*  Categorized  cl*  At tiXudlnal? 

•  There  is  only  one  learning  subcategory  associated  with  the  ATTITUDINAL  learn¬ 
ing  category.  It  is  "attitude-learning." 

•  Table  1-34  provides  a  definition  of  the  subcategory  and  provides  examples  jf 
action  verbs  and  learning  skills  commonly  associated  with  learning  objectives 
that  fall  into  the  attitude-learning  subcategory.  Study  the  table  carefully. 

Table  1-34 

ATTITUDINAL  LEARNING  CATEGORY 


Definitions  and  Examples  of  Learning  Subcategorv 


LtARN'NG  SUBCATEGORY 

DEFlNi  flOM 

OF  SUBCATEGORY 

COMMON 
ACTION  VERBS 

examples 

Attitude  learning 

To  exhibit?  a  patten’  of 
behavior  or  of  response 
towards  something 

Accept 

Choose 

Comply  with 

Wot  king  instead  ot  wasting  time 

Complying  with  safety  regulations 

Keeping  bunk  neat  when  opportunity 
exists  to  keep  it  untidy 

•  If  you  find  yourself  unable  to  fit  your  learning  objective  into  the  attitude-learning 
subcategory  see  your  supervisor  for  assistance.  Perhaps  the  learning  objective 
should  have  been  categorized  as  MKNTAI,  or  PHYSICAL.  Or  perhaps  the  learn¬ 
ing  objective  was  incorrectly  written.  You  may  need  to  refine  and  rewrite  it.  If 
such  is  the  case,  be  certain  to  coordinate  with  the  individual  who  originally  pre¬ 
pared  the  learning  objective  BEFORE  YOC  MAKE  ANY  CHANGES  TO  THE 
LEARNING  OBJECTIVE' 

•  The  learning  subcategory  (attitude-learning)  is  recorded  in  Section  III,  Column  B. 
Look  at  the  example  on  the  following  page  to  see  how  it  should  be  recorded. 


Hou)  and  ulhcAe  do  I  Record  the.  Learning  Stab  category? 

•  The  learning  subcategory  (attitude-learning)  is  recorded  in  Section  III.  Column  B. 
Look  at  the  example  provided  below  to  see  how  it  should  be  recorded. 


What  Voei,  the  LAR  Sheet  Look  Ltke  A&teti  the 
Leaguing  Subcategosuj  Ha.s  Been  Recorded? 

EXAMPLE: 

ISD  III  1  Specify  Learning  Events/Activities 

turns  Kcrnims  mourns  sheet 


(LAR  She*t) 


Huic  do  1  Identify  Appropriate  Leaguing  A ctiviotie* 
Teaching  Leaguing  Objective,*  Categorized  cl*  Being 
Attitude- Leaning? 

•  Then-  is  a  sot  of  learning  activities  which  must  be  used  for  successfully  teaching 
learning  objectives  categorized  as  being  attitude-learning.  Guidelines  for  devel¬ 
oping  the  learning  activities  are  provided  on  page  1-37.  Relate  the  learning 
guidelines  to  your  learning  objective  and  develop  learning  activities  specific 

to  your  learning  objective. 

•  Record  the  appropriate  learning  activities  for  training  the  learning  objective  in 
Column  (',  Section  III.  LAP.  Sheet. 


ATTITUDE  LEARNING 


LEARNING  ACTIVITIES  MUST  FEATURE:  arrangement  of  the  enviornment  in  which  the  trainee  lives 

and  works  so  that  correct  and  appropriate  behavior  is 
elicited  from  the  trainee.  Reinforcement  and  rewarding  of 
all  instances  of  correct/appropriate  behavior  which  the 
trainee  demonstrates  must  be  provided.  NOTE:  An  attitude 
is  a  pattern  of  behaving  or  responding,  not  a  mystical  set  of 
the  mind.  It  is  more  difficult  to  get  a  trainee  to  adopt  an 
attitude  than  it  is  to  get  him  to  acquire  information  or  a 
skill.  "Preaching"  is  rarely  the  best  way  of  teaching 
attitudes.  It  is  better  to  use  means  such  as  behavior 
modeling,  giving  rewards,  etc. 


EXAMPLE  OF  LEARNING  OBJECTIVE:  The  soldiei  will  keep  his  bunk  neat  and  clean  at  all  times. 


Guidelines  for  Determining 
Appropriate  Learning  Activities 


1.  State  and/or  demonstrate  appropriate/desired 
behavior(s). 

2.  Encourage  trainee  performance  of  appropriate/ 
desired  behaviors  by  using  devices  such  as 
behavior  modeling,  role-playing,  appeal  to 
authority. 

3.  Reinforce/reward  instances  when  trainee  emits 
appropriate/desired  behavior.  Do  not  reinforce/ 
reward  instances  of  inappropriate/undesired 
behaviors.  On  occasion,  and  if  relevant,  punish 
inappropriate  behaviors. 


Examples  of  Appropriate 
Learning  Activitise 


1.  Describe  the  appropriate  manner  in  which  the 
soldier's  bunk  should  be  maintained. 

2.  Encourage  the  trainee  to  keep  the  bunk  neat  by 
role-playing  situation  in  which  a  messy  bunk 
leads  to  loss  of  time,  loss  of  priveleges,  loss  of 
equipment,  etc.  OR,  show  a  film  in  which  a 
soldier  tidies  his  bunk,  etc. 

3.  Praise  the  trainee  whenever  his  bunk  is  left  neat. 
Penalize  him  whenever  it  is  kept  messy. 
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W licit  Vo&>  tkn  Lucuining  AcJxoiotLoj*  RacoticLing  Sh&eX  (LAR) 
Look  Like.  A^t&i  Appropriate,  Leaguing  Activttie^  Have. 
Bean  Recorded? 

EXAMPLE: 

ISD  III  1  Specify  Learning  Events/Activities 

LEARNING  ACTIVITIES  RECORDING  SHEET 


(LAR  Shwt) 
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to  block  34 


from  block  33 


•  Cui'r.y  (he  •nstMiC(ii]:i  aci-vititi  seiKtiiKi  pi-jceu 
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u'ti  this  step  Similarly,  informal, on  may  have 
been  obtained  (fiat  would  be  useful  t-.i  persons  who 
wiil  be  engaged  to  Instructional  Systems  bevel  op 
men;  steps  ilia;  Snilow  this  one 


'  Keio'd  Comments  mi 
l|  ISO  COf  ROlNATlON 
j:  SHEET 


•  C.iriments  an-  recorded  a>-d  $i>bnniipd  in 
appropriate  peisons 

•  For  furtliei  guidance,  see  below 


WkaX  it,  tkz  ImpoAMincz  ofi  Pn.zpaAx.ng  Commzntt  fioA  PzopZz 
WoAking  in  OtiizA  Stzpt  o &  tkz  InttAuztionaZ  Syttzrn 
VzvzZopmznt  PAozzt. t?  Hou)  do  I  RzcoAd  Thzm? 

In  order  for  the  Instructional  Systems  Development  process  to  work  effectively,  it 
is  imperative  that  there  be  forward  and  backward  communication  between  the 
people  involved  in  the  process.  At  some  time  or  other,  you  have  probably  com¬ 
plained  about  the  input  that  has  been  provided  to  you.  For  example,  you  may  have 
thought  that  the  learning  objectives  which  you  need  as  input  for  this  block  were  not 
as  well  written  as  they  could  have  been.  Sometimes,  you  may  have  had  to  do  work 
that  should  have  been  performed  in  previous  steps  in  the  system. 


IT  IS  IMPORTANT  THAT  YOU  FEED  THIS  INFORMATION  BACK 
TO  THE  APPROPRIATE  PEOPLE  SO  THAT  REVISIONS  CAN  BE 
MADE  TO  EFFECT  IMPROVEMENT  IN  THE  END  PRODUCT. 
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In  your  research  for  this  step  of  the  Instructional  Systems  Development  process  you 
may  also  have  discovered  information  that  you  think  may  be  useful  to  people  who 
will  be  working  in  steps  that  follow  this  one.  If  so,  it  is  equally  important  that 
you  pass  this  information  on  to  appropriate  people. 

REMEMBER,  COMMUNICATION  WITHIN  THE  INSTRUCTIONAL 
SYSTEMS  DEVELOPMENT  PROCESS  IS  CRITICAL  FOR  EFFEC¬ 
TIVE  INSTRUCTIONAL  DEVELOPMENT 

•  A  copy  of  the  ISD  COORDINATION  SHEET  can  be  found  in  the  back  of  this 
manual.  Make  sufficient  copies  to  enable  you  to  send  one  to  every  individual 
you  wish  to  communicate  with— plus  copies  for  your  records. 

•  Complete  the  ISD  COORDINATION  SHEET  in  duplicate.  Send  one  copy  to  the 
individual  and  attach  one  copy  to  the  Instruction  Settings  Selection  Package 
(ISR  Sheets). 
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SPECIFYING  INSTRUCTIONAL  MANAGEMENT 
PLAN  AND  DELIVERY  SYSTEM 

ISD  1 1 1.2 


Manual 


This  is  the  10th  in  a  series  of  ISD  Job  Aids  for  use  in  instructional  design  and 
development.  This  volume  is  to  be  used  as  a  supplement  to  the  primary  document, 
“Job  Aids:  Descriptive  Authoring  Flowcharts  ISD  III. 2  Specify  Instructional  Manage¬ 
ment  Plan  and  Delivery  System.”  The  flowchart  document  will  direct  you  to  specific 
guidance,  examples,  and  references  provided  in  this  volume.  If  you  do  not  have  the 
primary  flowchrH  document,  request  it  from  your  supervisor. 


The  wording  in  this  manual  should  not  be  construed  to 
discriminate  between  the  sexes.  In  order  to  avoid  a 
repetitious  use  of  the  terminology,  "he/she,"  the  terms, 
“he,"  "him,"  and  "his,"  as  well  as  "men,"  are  intended 
to  include  both  the  masculine  and  feminine  gender.  Any 
exceptions  to  this  usage  will  be  so  noted. 
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Specify  Instructional  Management  Plan  and  Delivery  System 


This  introduction  provides  the  usei  with 
instruction  on  the  basic  structure  o>  the 
Job  Aids  and  gives  guidance  for  their  use 


•  Refer  to  Introduction 
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«  For  detailed  overview,  see  below 


bJhcU  tt>  the,  Job  Kid  ^oh.  Setectlng  VettveJiy  Syi,temi> 
alt  about? 

•  GOAL 

—  The  purpose  of  this  job  aid  is  to  help  you  apply  a  systematic  approach  to  the 
selection  of  delivery  systems  (media)  for  presenting  instruction  to  trainees. 
This  systematic  approach  to  media  selection  requires  consideration  of  the 
nature  of  the  objectives:  their  learning  categories/subcategories,  learning  activ¬ 
ities  and  instructional  settings.  Such  factors  as  equipment  and  facility  con¬ 
straints,  cost  of  procurement,  cost  of  replacement,  development  costs,  etc. 
must  also  be  considered. 

—  Once  the  candidate  delivery  systems  have  been  selected,  the  management  plan 
can  be  specified.  Please  note  that  this  job  aid  includes  only  the  selection  of 
delivery  systems. 


•  OBJECTIVES 

1)  Given  a  group  of  learning  objectives  (LOs)  with  their  specified  learning  activ 
ities,  instructional  settings  and  learning  categories,  use  the  appropriate  learning 
subcategory  matrix  to  select  candidate  delivery  system(s)  for  each  LO. 

2)  From  the  list  of  candidate  delivery  systems,  select  the  one(s)  most  appropri¬ 
ate  for  the  whole  task  rather  than  for  the  whole  course. 


NOTE:  Do  not  spend  too  much  time  reading  or  studying  this  material.  You  will  be 
given  more  specific  information  later. 


J.4 


NOTE: 


PRODUCTS 

—  The  input  for  this  block  is  the  learning  activities,  learning  categories,  anti  instruc¬ 
tional  settings  for  each  learning  objective.  The  output,  or  products,  include: 

•  A  completed  Delivery  System  Planning  (DSP)  Sheet  for  each  task  showing: 

a)  candidate  delivery  systems 

b)  selected  delivery  system(s)  for  whole  task 

•  Final  decision  on  the  delivery  system(s)  to  be  used  for  a  whole  course.  This 
decision  is  recorded  in  the  System  Master  Plan,  which  is  not  included  in  this 
job  aid. 


OVERVIEW  OF  MAJOR  STEPS  IN  SELECTING  INSTRUCTIONAL 

DELIVERY  SYSTEMS 

Step  1.  Learning  objectives  action  statements  with  their  corresponding  leamii.t 
categories/subcategories  are  recorded  on  DSP  Sheet. 

Step  2.  On  the  appropriate  learning  subcategory  matrix,  the  criteria  specified  by 
the  inputs  to  this  block  are  checked. 

Step  3.  These  checked  criteria  are  examined  in  reference  to  each  delivery  system 
on  the  matrix  to  determine  which  systems  meet  the  criteria. 

Step  4.  Based  on  this  examination,  candidate  delivery  systems  are  specified  and 
recorded  on  the  DSP  Sheet.  Final  selections  are  made  with  the  help 
or  management. 


Do  not  spend  too  much  time  reading  or  studying  this  material.  You  will  be 
given  more  specific  information  later. 


J.5 


NOTE: 


t 


WORKSHEET  USED 

—  A  partially  completed  Delivery  System  Planning  (DSP)  Sheet  can  he  seen 
on  pages  J-48  and  J-49. 

—  Learning  Category  Matrices  are  shown  on  pages  J-50  through  J-5S. 


DESCRIPTIVE  FLOWCHART 

—  The  flowchart  on  pages  J-59  through  J-61  shows  the  steps  in  the  use  of  the  Job 
Aid  for  Selecting  Delivery  Systems.  The  flowchart  will  be  useful  to  you  in 
getting  a  clear  picture  of  the  overall  process  used  in  this  job  aid. 


Do  not  spend  too  much  time  reading  or  studying  this  material.  You  will  be 
given  more  specific  information  later. 


J-6 


from  block  5 


Yes 


•  These  sheets  describe  the  learning  activities 
suggested  tor  every  learning  elective  owthm 
a  single  task 


7 


Guidance  for  Obtaining, 
Prepaimg  Learning 
Activities  Recording 

Sheets 

•  Learmg  activities  tor  each  task  should  be 
availab?as  output  Irom  ISD  III  1  Specify 
leami  g  Events/ Activities 

•  It  pro  edores  tor  specifying  learning  activities 
meie  not  complete,  go  to  Job  Aid  Oescnptive 
Authoring  Fiowchatti.  t  3 

•  When  lists  of  learning  ob|ectives  and  then 
corresponding  learning  activities  have  been 
obtained,  return  to  Block  6 


to  block  8 


from  blocks  6  and  7 

-  -  . 

Obtain  Leai mug  II 

Category  Matrices  ! 


nr~ 

to  block  9 


•  Learning  Category  Matrices  are  avai’aWe  lor  all  mne  learning  tubcafegones 
They  are  used  to  select  the  .new  appropriate  delivery  system  Ip.  training  each 
task. 

•  For  further  information  and  guidance  on  obtaining  Learning  Category  Matrices, 
see  below. 


t  cuio,  tka  Le.asuu.ng  Category  MafriiaeA? 

•  The  matrices  are  designed  to  help  you  make  decisions  for  the  most  appropriate 
media  (delivery  systems)  for  each  learning  objective,  or  group  of  learning  objectives. 

•  The  items  on  each  matrix  are: 

1)  Criteria  for  Selecting  Instructional  Delivery  Systems 

a)  Training  Setting  Criteria 

b)  Administrative  Criteria 

c)  Stimulus  Criteria 

d)  Complexity  Criteria 

2)  Alternative  Instructional  Delivery  Systems 

a)  Delivery  approaches  permitting  the  application  of  all  learning  guidelines 
(suggested  activities)  for  that  learning  subcategory 

b)  Delivery  approaches  that  permit  the  use  of  only  some  of  the  guidelines 

3)  Names  of  the  Media 

•  Since  many  of  the  names  may  be  unfamiliar  or  different  from  the 

terms  used  by  your  school,  a  glossary  of  instructional  delivery  systems 
is  provided,  if  needed,  in  a  later  step  of  this  job  aid. 

•  To  see  examples  of  the  matrices  refer  to  pages  J-50  through  J-58. 

•  Note  that  all  of  the  Criteria  for  Selecting  Instructional  Delivery  Systems  are  not 
listed  for  each  ,;ubcategory.  When  one  or  more  criteria  are  missing  it  is  because 
they  do  not  contribute  to  the  analysis  for  that  particular  subcategory. 


1.8 


WheAe.  do  I  obtain  Learning  Catzgotiy  Mat/iice^? 


•  Learning  Category  Matrices  are  available  for  duplication  in  the  pocket  at  the  end 
of  this  manual. 

•  Note  that  there  are  nine  matrices  covering  the  front  and  back  of  two  separate 
sheets.  The  six  mental  skills  subcategories  are  on  one  sheet.  The  two  physical 
and  one  attitudinal  skills  are  on  the  other. 

•  Make  several  copies  of  each  sheet  as  you  will  be  using  them  over  and  over  again. 


from  block  8 


to  block  10 


m 


from  block  9 


to  block  1 1 


•  Delivery  System  Planning  <0SP)  Sheets  ate  used  to  document  candidate  delivery 
systems  which  meet  the  criteria  specified  by  the  learning  activities  for  each 
ob/ethee  from  this  group  of  dndidt  le  delivery  systems  the  final  selection  of 
delivery  systemtsl  for  the  whole  task  is  made 

•  For  guidance  m  obtaining  DSP  Sheets,  m  below 


WheAz  can  I  get  the  VctiveAy  System  Planning  ( VSP )  SkceXA? 

•  Delivery  System  Planning  Sheets  (DSP)  are  available  for  duplication  in  the  pocket 
at  the  back  of  this  manual. 

•  To  see  a  partially  completed  DSP  Sheet  refer  to  page  J-48. 


from  block  1 1 


Hecofd  ALL  Learning 
'  &)<cti»e  Action 
Sfaieroann 
[Section  til  (A). 

OSP  c>h«tl 


•  F  '•  tuithf  mtu'Riation  and  guidance.  tttMiw 


to  block  13 


Holv  do  I  >mcond  aJUL  the  ZcaAnlng  objcctlvct  action 
AtaXmcntt,? 

•  The  learning  objectives  action  statements  (do  not  include  conditions  and  standards) 
can  be  copied  directly  from  the  Learning  Activities  Recording  Sheet,  or  any  pre¬ 
viously  prepared  worksheet  on  which  the  LOs  are  recorded. 

•  Record  all  the  LO  action  statements  belonging  to  the  task. 


Example: 


^ - _  *■"  <ui  jSii'. 

>vmtmi _  _ JUiLtOiJa  -kti:!  K*r  /  C  i> c  ^ jj -  * 


StCtlON  II  iai  5nr<  si  OU'wy  SvVfi' 


irrnTT-- 

jlijijjjh 


W- 


•t-t-t  •  t- 


from  block  13 


Racord  Learning 
Category  and  Subcatagory 
(Section  III  (B). 

DSP  Sheet  I 


•  For  forth*-  information  and  guidance,  nab 


to  block  1 5 


Holv  do  I  sie.cosid  the.  lejvwing  ccut<LQOK.y  and  Aubcatzgosiy? 

•  The  learning  category  and  subcategory  for  each  LO  can  be  copied  directly  from 
the  Learning  Activities  Recording  Sheet,  or  any  previously  prepared  worksheet 
on  which  this  information  is  recorded. 

•  Record  the  learning  category /subcategory  for  each  objective  by  placing  an  “X” 
in  the  appropriate  cell  in  Section  III  (B). 


SECTION  H  (At  Selected  Oeliverv  Systemfn 


Learning  Ob|«tt<vet  Acno 


Learning  Category  Subcategonei 

Name'  ~  [phv».cai  1  Attitude] 


/  Hr  III!  I 


If  1  IS 


5 


/ec  f- 


Most.  pt»i 


•i*  I  I  jxi  ! 


,  !< 

4-L  — --W 


0-  **+''*'” 


I  l  L  -  i 


MM 


!  M  !  i 


from  block  1 4 


IS 


•  The  matrix  is  located  lor  the  learning  subcategory  which  has  an  X  in 
Section  III  8  for  this  objeciirt  For  example,  it  there  u  an  X  m  the 
column  for  Gross  Motor  Skills,  then  that  is  the  matrix  to  be  used 


to  block  16 


Locate  Appropriate 
Matrix  for  This  Learning  ; 
Category  and  Subcatigary 
(Learning  Category 
Matrix) 


I 

i 

I 

i 


! 


J- 16 


I 


from  block  15 


Record  Appiopnate 
"T'aimntj  Setting 
Catena "  l  Learning 
Category  Matin  i 


to  block  17 


•  A  light  check  mark  K  )  n  made  on  the  maim  to  mditaie  the  enter ■* 
specified  by  the  instructional  setting  and  teaming  activities  for  this  obiective 

•  For  tuither  guidance,  see  below 


Hocv  do  I  fi<ic.osLd  the  appropriate  training  netting 
criteria  on  the  matrix.? 

•  In  the  first  column  to  the  right  of  the  criteria  for  Selecting  Instructional  Delivery 

Systems,  you  will  see  empty  ceiis.  Place  a  ‘V  ”  (light  pencil  so  that  it  can  be 

easily  erased)  in  the  cells  representing  the  training  setting  criteria  that  must 

be  met. 

•  For  example:  (See  Learning  Category  Matrix— Mental  Skills,  Recalling  Information) 

—  If  the  instructional  setting  for  the  task  is  “institution,”  you  might  check  large 
group  at  a  single  location,  “or  individual  trainees  at  a  fixed  location.” 

—  If  the  instructional  setting  is  “SOJT,”  you  might  check  “team  setting”  or 
“small  group.” 

—  If  the  instructional  setting  is  “STEP,”  you  might  check  “individual  trainees 
with  independent  instruction  at  any  location.” 

—  If  a  particular  criteria  is  not  stated,  it  is  because  that  criteria  is  not  a  significant 
factor  for  this  learning  category. 


J- 17 


from  block  16 


Rtco/d  Apfwopmit 
"Acjmini*lrMiv«  totciia*' 
I  turning  Category 
Matrix) 


to  block  18 


•  A  fight  check  mark  lv  In  made  on  the  matrix  to  mtftcitf  the  criteria 
specified  by  the  mitructional  management  plan  tot  this  objective 

•  For  further  guidance,  aea  below. 


How  do  I  h.<Lc.on.d  the.  appropriate.  admtniitrattve  critejUa 
on  the,  matrix? 

•  In  the  same  column  of  empty  cells  used  in  the  last  step,  you  will  place  a  “V  ” 
(light  pencil  again)  in  the  cells  representing  the  administrative  criteria  that  must 
be  met. 

•  For  example:  (See  example  on  page  J-20) 

—  If  you  have  very  limited  funds  for  delivery  systems  and  all  your  material  must 
be  developed  at  your  school  you  would  check: 

local  -  under  “Site  of  Courseware  and  Special  Hardware  Development” 
low  -  under  “Magnitude  of  Acquisition  Cost” 

NOTE:  There  should  be  two  checks  for  administrative  criteria. 


•  Example  of  matrix  with  administrative  criteria  checked: 


from  block  17 


No 


to  block  20 


Yes 


19 


r  h 

Record  App 
"Stimulus  C 
1  Learning  C. 
Matrix! 

opnate 

iteria" 

legory 

f 

All  matrices  include  Stimulus  Criteria  except 
Subcategory  Identify  Objects  and  Symbols 
(Mental  Skills) 

-  Subcategory  Gross  Motor  Skills  (Physical  Sk  its) 
•  Subcategory  Attitude  Learning  (Attitude  Skills) 


•  A  light  check  mark  (  \  )  is  made  on  the 
matrix  to  indicate  the  criteria  specified  by  the 
learning  activities  for  tins  objective 

•  For  further  guidance,  see  below. 


Haul  do  I  fvuiond  tke.  appnjophAXLto,  t>£mu£iu>  c AAXeJvia? 

•  In  the  same  column  of  empty  cells  used  in  the  last  step  you  will  place  a  ‘V” 
(light  pencil  again)  in  the  cells  representing  the  stimulus  criteria  that  must  be  met. 

•  Check  the  suggested  learning  activity  for  this  objective.  If  the  activity  involves 
sound  alone,  consider  the  choices  under  audio  stimuli.  If  the  activity  involves 
visual  stimuli,  specify  which  visuals  are  needed.  For  each  stimulus  criteria 
applicable  to  the  selected  learning  activities  put  a  check  mark  in  the  empty  cell. 

•  Example  of  matrix  with  stimulus  criteria  checked: 


/' 


Complexity  Cruei  •« 

•  Difficult  Motor  Ads 

•  Smooth  Motor  Performance  at 
End  of  Training 

Stimulus  Criteria 
Visua)  Form 
Alphanumeric 
Pictorial.  Plane 
Obiect.  Solid 
Visual  Movement 
Still 

Full  Movement 
Audio 

Voice  Sound  Range 
Full  Sound  Range 
Ambient  Sounds 
Other 

Tactile  Cues 
Internal  Stimulus  Motion  Cues 


J-2  1 


from  blocks  18  and  19 


Do« 

<^1 Matrix  Contain  Yes 

'  Complexity  Criteria" 


Record  Appropriate 
‘'Complexity  Criteria" 
|  Learning  Category 
Matrix! 


Complexity  Criteria  apply  only  to  responsive 
motor  skills. 


•  A  light  check  mark  (•.'  !«  made  on  the 
matrix  to  indicate  the  criteria  specified  by 
learning  activities  for  this  objective 

•  For  further  guidance,  see  below 


to  block  22 


How  do  I  tuLdotid  the.  appsiopsotiite.  complzxAJty  cjuXqaJji 
on  thz  mcut/ilx? 

•  In  the  same  column  of  empty  cells  used  in  the  last  step  you  will  place  a  ‘V” 
(light  pencil  again)  in  the  cells  representing  the  complexity  criteria  that  must  be 
met.  (These  criteria  apply  only  to  responsive  motor  skills). 

•  For  example: 

—  Read  the  action  statement  and  check  the  suggested  learning  activities.  Decide 
whether  this  is  a  “difficult  motor  act”  or  whether  the  goal  is  “smooth 
motor  performance  at  the  end  of  training,”  or  both. 

•  Example  of  matrix  with  complexity  criteria  checked: 


LULdl 

Cenfi  at 

•  Magnitude  of  Acquisition  Cost 

Low 

_ Hiab _ 

Complexity  Criteria 

•  Difficult  Motor  Acts 

•  Sr  ooth  Motor  Performance  at 
End  of  Training 

Stimulus  truer ia 

•  Visual  Form 

Alphanumeric 
Pictorial.  Plane 
Obiect,  Solid 

•  Visual  Movpm*"* 


XXX  X  X  XXX  X  X 


X  X  X  X  X  X 


X  X  _X| 

X  |  « 


JtT-  It  H  x  lxi 


X  X  X  X  X  X  X  X  X 

nr  x  x  x  * 1  ~ 
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from  blocks  20  jnd  21 

»  _  I  _ 


Examine  "Altwnatn* 
InttructionaJ  Olivary 
Syittira" 

llaarning  Category 
Matrix  I 


to  block  23 


•  Thera  ere  two  groups  of  alternative  instructional  delivery  systems  the  first  group 
consists  of  (hose  which  meet  all  the  critena  completely,  the  second  group  consists 
of  delivery  systems  which  are  adequate  but  do  not  meet  the  criteria  completely 

•  For  further  explanation  of  the  delivery  systems,  see  Appendix  A.  pages  J  61  ihru  70 


Whcut  <xa<l  the,  attoAncutive.  ZnA&mcjtionat  doJUv&iij  6y6tejm? 

•  Look  at  the  matrix  for  Identifying  Objects  and  Symbols  (Mental  Skills).  The 
alternative  instructional  delivery  systems  for  this  matrix  are  shown  diagonally. 
They  are: 

—  CAI  (with  visual  display) 

—  Teaching  Machine— Branching 
—  Programmed  Text— Branching 
—Microfiche  with  Self-Scoring  Tests 
—  Study-Card  Sets  with  Self-Scoring  Tests 
—  Traditional  Classroom 
—  Textbook 
—  Chart 

—  Automatic  Rater 

•  Listed  below  is  a  complete  list  of  instructional  delivery  systems  that  appear  in 
the  matrices. 

Audio  Only  Systems 

Audio  Disc  Playback  System 
Audio  Tape  System 

Audio-Visual 

Audio  Tape  With  Printed  Material 

Classroom  -  Traditional 

Filmstrip  Projection  System  With  Audio 

Filmstrip  Projection  System  With  Audio  and  Adjunct  Equipment 
Motion  Picture  Projection  System  -  Commercial,  16MM  and  Super  8MM 
Films 

Motion  Picture  Projection  System  -  Low  Budget  16MM  and  Super  8MM 
Films 

Microform  With  Information  Mapping,  and  Audio 
Instructional  Kit  With  Instructor 
Instructional  Kits  for  Trainees 


Overhead  Projection  System  With  Instructor 
Sound  Slide  Projection  System 

Teaching  Machine  -  Branching,  Still  Visual  With  Audio 
Teaching  Machine  -  Branching,  Still  and  Motion  Visual  With  Audio 
Teaching  Machine  -  Branching,  With  Adjunct  Equipment 
Teleconference  System 
Television  -  Cable  (CATV) 

Television  -  Closed  Circuit  (CCTV)  Without  Feedback 

Television  -  Portable  Video  Tape  System 

Carrel  -  AV  Equipped 

Carrel  -  Laboratory 

Computer  Assisted  Instruction  (CAI) 

Computer  Assisted  Instruction  •  PLATO  IV  Basic  Configuration 
Computer  Assisted  Instruction  -  PLATO  IV,  Basic  Configuration  and 
Audio 

Computer  Assisted  Instruction  -  PLATO  IV,  Basic  Configuration  With 
Adjunct 

Computer  Assisted  Instruction  -  PLATO  IV  Basic  Configuration  With 
Adjunct  Equipment  and  Audio 
Computer  Managed  Instruction  (CMI) 

CMI  -  CAI  TICCIT 

Computer  Simulation 

Computer  Simulation  -  On-Line 
Computer  Simulation  -  Off-Line 

GAME  -  Computer  Simulation,  Solitaire,  With  Visual  Display 

Operational  Equipment  With  Manuals 

Operational  System  -  Real  Environment 

Operational  System  -  Synthetically  Simulated 

Operational  System  -  Synthetically  Stimulated 

Procedure  Trainer 

Procedure  Trainer  -  Adjunct  Displays  and  Logic 
Simulator 

Simulator  -  Adjunct  Displays  and  Logic 
Specimen  Sets 

Physiological  Trainer  (Hostile  Environment)  Visual 

Physiological  Trainer  (Hostile  Environment)  Surface  and  Internal  Senses 

Visual  Only 

Filmstrip  Projection  System 
Microform  With  Information  Mapping 

Microform  With  Information  Mapping  and  Adjunct  Equipment 
Slide  Projector  System  -  2”  x  2” 

Simulation  -  Paper 

Teaching  Machine  -  Linear,  Still  Visual 
Teaching  Machine  -  Branching,  Still  Visual 


J-24 


Print  Materials 

Case  Study  Folder 
Flash  Cards 

Printed  Materials  -  Handouts 
Printed  Materials  -  Performance  Aids 
Printed  Materials  -  Reference  Books 
Printed  Materials  -  Self  Scoring  Exercises 
Printed  Material  -  Workbook 
Printed  Material  -  Textbook 
Programmed  Text  -  Branching 

Programmed  Text  -  Branching  With  Adjunct  Material/Equipment 
Programmed  Text  -  Linear 

Programmed  Text  -  Linear  With  Adjunct  Material/Equipment 
Study  Card  Sets 

Special  and  Non-Standard  Items 

Automatic  Raters  -  Informal  Training 

Carrel  -  Dry 

Do-It-Yourself  Kits 

Game-Manual  Simulation 

Game  -  Manual  Non-Simulation 

Game  -  Computer  Supported  Simulation 

Logic  Trainers 

Mockups,  Panels,  and  Demonstrators  -  Dynamic 
Models  and  Static  Mockups  -  Small  Scale 
Mockups,  Panels,  and  Demonstrators  -  Static 


•  Some  of  the  instructional  delivery  systems  listed  on  the  matrices  may  be  unfamiliar 
to  you  or  different  from  the  terms  used  by  your  school.  Therefore,  a  glossary  of 
instructional  delivery  systems  is  shown  in  Appendix  A  to  this  Manual  (page  J-63). 


from  block  22 


Or«w  Lint  Through  Any 
Dthvtry  SyittmU)  Clearly 
Noi  Available  tor  Training 
Th«  iMmm g  Objective 
lltarning  Category  Malnal 


to  block  24 


•  For  further  guidance,  tat  Mow 


CM cut  iA  the  puApo-6  e.  dAaialng  a.  tine,  thjwagh  unavcutable. 
deZiveAy  t>y&temt>'! 

•  Many  of  the  delivery  systems  included  on  the  matrices  will  not  be  available  to 
your  school  in  the  foreseeable  future.  In  that  case  you  can  eliminate  them  from 
your  analysis  by  marking  them  off  on  the  matrix. 


•  You  may  have  had  to  mark  off  several  of  the  alternative  delivery  systems  and  are 
now  wondering  why  so  many  that  are  presently  unavailable  were  included  on  the 
matrix.  One  reason  is  to  make  course  development  personnel  and  management 
more  aware  of  the  possibilities. 

While  the  media  and  delivery  systems  are  usually  selected  on  the  basis  of  equipment 
availability,  local  past  experience,  and  available  production  facilities,  there  are  other 
important  considerations  which  should  be  taken  into  account  to  make  better  long 
range  plans.  Techniques  have  been  developed  for  the  projection  of  procurement 
and  revision  costs  in  a  wide  variety  of  instructional  media.  Frequently,  there  can 
be  a  large  discrepancy  between  the  projected  costs  of  an  existing  or  available 
delivery  system  and  one  which  has  been  optimally  designed. 

Large  discrepancies  of  this  nature  can  often  serve  as  the  basis  for  management 
decisions  to  embark  on  a  new  approach  to  instruction  when  it  can  be  shown  that 
the  new  approach  will  have  important  payoffs  either  in  costs,  time  reductions,  or 
increases  in  effectiveness.  While  it  may  not  be  cost  effective  to  invest  in  a  new 
delivery  system  for  a  single  course  of  instruction,  such  an  investment  may  have  a 
significant  pay-off  over  time.  Data  accumulated  through  time  will  provide  an 
important  source  of  information  for  management  in  making  better  long  term 
decisions. 

New  delivery  systems  and  techniques  often  become  fashionable  simply  because  they 
are  available.  In  this  block,  procedures  are  defined  for  selecting  one  or  more 
suitable  media  for  specific  learning  events  and  activities.  By  using  this  approach, 
delivery  systems  can  be  selected  on  the  basis  of  defined  requirements  rather  than 
on  the  basis  of  availability  or  the  appeal  of  currently  existing  fads. 


J-28 


from  block  23 


Euount  Fir*t/M®*t 
Potcnliti  Instructional 
Delivery  System 
1  Leer  rung  Category 
Matrix] 


to  block  25 


•  For  further  guidance  on  examining  delivery  systems  for  suitability.  see  below. 


What  i*>  the  punpoie  oft  examining  each,  instructional 
delivery  system  on.  &ie  matrix? 

•  Now  you  are  ready  to  use  the  algorithm  which  has  been  set  up  for  you  on  the 
matrix.  As  you  look  at  each  delivery  system  remaining  on  the  matrix  you  will 
be  noting  which  ones  have  X’s  opposite  the  criteria  you  have  checked  (V)  in 
light  pencil. 

•  The  delivery  systems  which  have  Xs  prerecorded  for  all  or  most  of  the  criteria 
you  have  checked  (V)  will  become  candidate  delivery  systems.  The  training  setting 
and  administrative  requirements  will  be  the  same  for  all  learning  objectives  within 

a  single  task,  or  even  a  group  of  tasks,  but  the  stimulus  and  complexity 
criteria  may  change  with  each  objective.  It  is  necessary  to  note  all  the  X’s  in 
the  rows  next  to  your  checked  (V)  criteria  in  order  for  the  algorithm  to  work 
correctly. 

•  Flowchart  blocks  24  through  36,  which  follow,  will  lead  you  through  the  analysis. 

NOTE:  You  are  to  deal  with  only  one  Instructional  Delivery  system  at  a  time  as  you 
work  through  flowchart  blocks  24  through  36. 


What  doeA  the  matxix  took  Like,  when  a  deLLvexy  AyAtem 
meet*  the.  &thnuJLuA  cxltexia'! 
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from  clock  32 


to  block  35 


(jJkcut  dozA  the  matnlx  look  tike.  u)ke.n  a.  deJUvexy  i>yt>£em 
meet6  the.  complexity  exltexla? 
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from  blocks  33  and  34 
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RKaid  the  Otlivtry 
System  on  DSP  Sheet 
[Section  III  (Cl. 

DSP  Sheet] 


to  block  36 


•  Fat  guidance  m  tecoufeng  the  delivery  rystem  on  DSP  Sheet  tee  below 


How  do  I  select.  and  aeeoad  a  candidate.  deJUveay  system? 

•  You  have  reached  this  block  because  the  delivery  system  you  have  been  examining 
has  an  “X”  recorded  for  each  criteria  you  have  checked.  Therefore  this  is  a 
candidate  delivery  system. 

•  Since  it  is  possible  to  have  more  than  one  delivery  system  which  matches  all 
your  criteria,  leave  space  to  list  one  or  two  others  in  Section  III  (C). 

•  For  Example: 

DELIVERY  SYSTEM  PLANKING  SHEET 
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from  blocks  39  and  40 


Eiamint  All  Action 
Stittfflanti  and  Candidal* 
Qalirtfy  Syitymi 
tSaction  111  (A)  and  (C). 
QSP  Shatt 


to  block  42 


•  Foi  ( unhti  guidanc*  on  thapuipow  ot  this  examination. m  Mow. 


(jJkat  U>  the  pu/ipo&e  ol  looking  at  all  the.  aclion  » 

AtatejnentA  and  candidate  deJUvexy  Ay*  terns? 

•  If  the  learning  objectives  for  this  task  required  a  wide  variety  of  learning  activities 
due  to  belonging  to  several  different  learning  categories,  then  you  may  have  many 
different  candidate  delivery  systems.  However,  it  is  not  likely  that  you  would  use 
more  than  two  or  three  delivery  systems  for  a  single  task;  more  likely  you  will 
be  restricted  to  one.  In  this  case  you  will  have  to  select  the  delivery  system(s) 
which  appear  most  frequently  among  the  candidate  systems  you  have  listed  in 
Section  III  C.  In  this  step  you  are  checking  to  see  how  many  delivery  systems 
are  candidates  for  this  one  task. 


1 


l 
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from  block  41 


•  Goes  more  then  one  delivery  sysrem  mef?  your 
media  selection  criteria  tor  this  group  ol 
objective*? 


•  For  guidance  on  how  10  seletl  the  besi 
delivery  system,  tee  below 


to  block  44 


How?  do  I  thz  b£6t  deJLLv&iy  6y*tm  &osi  thJj> 

gtioup  ofi  obje.cXlv<LA? 

•  Since  you  have  more  than  one  candidate  delivery  system,  you  need  to  make  a 

further  analysis  to  determine  which  system(s)  is  most  practical  in  your  situation. 

•  A  delivery  system  may  be  rejected  as  being  too  impractical  for  one  or  more  of 

the  following  reasons: 

1.  Marginal  Technical  Solutions:  The  learning  guidelines  cannot  be  easily 
carried  out  with  the  medium. 

2.  State-of-the-Art:  The  basic  medium  is  under  development  or  being  tested 
and  may  not  be  available  for  practical  application  by  the  time  it  is  required. 

3.  Size  of  System:  Some  media  are  useful  within  large  training  programs, 
others  are  suited  only  for  small  programs  (and  therefore  may  not  be  suited 
to  the  size  program  being  considered.) 

4.  Interface  with  Existing  Program:  Many  new  courses  must  be  designed  to  fit 
into  existing  programs,  which  places  constraints  on  the  new  courses;  e.g., 
equipment  on  hand,  available  classrooms,  scheduling  practices,  etc. 

5.  Time  to  Produce  Media:  Media  which  require  long  lead  times  for  development 
may  not  be  useful  when  scheduling  does  not  permit  a  long  development  cycle. 

6.  Budget  Cycle  Constraints:  While  the  application  of  some  of  the  effective 
training  approaches,  such  as  CCTV  (closed  circuit  television),  may  result  in 
low  costs  per  student  graduate,  the  initial  investment  is  substantial.  Unless 
these  resources  appear  in  existing  budgets,  the  application  of  these  techniques 
to  an  immediate  problem  is  not  feasible. 


* 


j  -4  i  ; 
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7.  Adoption  of  Innovations:  Project  team  members  frequently  resist  innovations. 
If  the  proposed  media  is  significantly  different  from  existing  techniques,  either 
adequate  resources  must  be  focused  upon  gaining  acceptance  for  the  innova¬ 
tion,  or  a  more  traditional  approach  must  be  selected. 

8.  Courseware  Development:  If  the  courseware  is  to  be  locally  developed, 
skilled  personnel,  equipment,  time,  and  dollars  must  be  available. 

9.  High  Cost  Alternatives:  The  projected  life  cycle  cost  of  a  media  approach 
may  be  significantly  higher  than  other  equally  useful  alternatives.  Reject 
high  cost  alternatives. 

10.  Learning  Style  of  Trainees:  If  trainee  has  low  reading  ability  or  would  be 
limited  in  his  ability  to  use  certain  kinds  of  media,  then  reject  these  media 
as  inappropriate. 

11.  Other  Constraints:  A  variety  of  other  practical  factors  should  be  considered; 
e.g.,  command  policy  and  existing  investment  in  production  facilities. 
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from  blocks  42  and  43 

44 _ 

Record  the  Selected 
Delivery  System!*!  and 
the  Basis  tor  You'  > 

Oeosion  l Section 
OSP  Sheet  I 


f  o<  luMher  guidance  and  example,  see  below 


to  block  45 


How  do  J  n.e.con.d  the.  *eZe.cte.d  deZlveAy  &yi>tm  and 
baAAJ>  {on.  my  deaciton? 

•  Space  has  been  provided  in  Section  II  (A)  for  the  delivery  system(s)  selected  for 
presenting  the  instruction  for  this  task. 

•  Space  has  been  provided  in  Section  II  (B)  for  your  rationale. 


EXAMPLE: 


ISD  III  2  Specify  Management  Plan  and  Delivery  System 

DELIVERY  SYSTEM  PLANNING  SHEET 
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from  block  44 


Hou)  u>  thz  u)kole.  c.ouaj>c  de/lv&uj  6y&£m  &eJL<icJ:£d? 

•  Having  completed  this  detailed  analysis  for  every  objective  of  every  task,  you 
have  arrived  at  the  most  technically  correct  and  practical  decisions. 

•  After  vour  supervisor  becomes  familiar  with  the  instructional  delivery  systems 
you  nave  selected  and  your  rationale,  he  can  consult  with  management.  Ideally, 
your  selections  would  become  final;  however,  the  final  choice  will  be  based  on 
a  cost  analysis  and  certain  administrative  factors,  irrespective  of  the  technically 
correct  solutions. 

•  Your  goal  has  been  achieved  when  you  make  the  technically  correct  solutions. 
After  management  becomes  aware  of  them  it  becomes  their  responsibility  to  make 
more  of  the  alternatives  available  in  the  future. 
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from  block  46 


to  block  48 


•  Thu  rub  aid  don  *>-i  inciuda  guidantp  *oi  computing  th#  SyKimi  Manaptmem 
Ran  ISMP) 

•  For  mloimatio'-  at—,'  what  •»  mciodad  m  fhr  SMPand  wh»-t  to  obtf'1  guidance 
«t  Mow 


What  Li>  the  System  Management  Plan? 

•  The  System  Management  Plan  provides  details  of  system  decisions  on  how  the 
instruction  will  be  developed  and  implemented.  It  includes: 

a)  Instructional  Management  Plan  (See  example  in  TRADOC  Pam  350-30, 

III. 2,  pp.  146  through  161). 

b)  Plan  for  developing  instruction. 

c)  Plan  for  evaluating  the  system. 

•  For  more  information  refer  to  TRADOC  Pam  350-30,  III. 2,  Specify  Instructional 
Management  Plan  and  Delivery  System. 
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from  block  47 


Wh at  aj>  tl le  importance.  o l  preparing  comments  fior  p'loptz 
working  in  other  AtzpA  ofi  the  instructional  systems 
development  process?  Hou)  do  I  record  them ? 

•  In  order  for  the  Instructional  Systems  Development  process  to  work  effectively 
it  is  imperative  that  there  be  forward  and  backward  communication  between  the 
people  involved  in  the  process.  At  some  time  or  other  you  have  probably  com¬ 
plained  about  the  input  that  has  been  provided  to  you.  Sometimes,  you  may  have 
had  to  do  work  that  should  have  been  performed  in  previous  steps. 


IT  IS  IMPORTANT  THAT  YOU  FEED  THIS  INFORMATION  BACK 
TO  THE  APPROPRIATE  PEOPLE  SO  THAT  REVISIONS  CAN  BE 
MADE  TO  EFFECT  IMPROVEMENT  IN  THE  END  PRODUCT. 


•  In  vour  research  for  this  step  of  the  Instructional  Systems  Development  process  you 
may  have  discovered  additional  information  that  you  think  may  be  useful  to  people 
who  will  be  working  in  steps  that  follow  thb  one.  If  so,  it  is  equally  important 
that  you  pass  this  information  on  to  appropriate  people. 


REMEMBER,  COMMUNICATION  WITHIN  THE  INSTRUCTIONAL  SYSTEMS 
DEVELOPMENT  PROCESS  IS  CRITICAL  FOR  EFFECTIVE  INSTRUC¬ 
TIONAL  DEVELOPMENT 


•  A  copy  of  the  LSI)  COORDINATION  SHEET  can  he  found  in  the  back  of  this 
manual.  Make  sufficient  copies  to  enable  you  to  send  one  to  every  individual 
you  wish  to  communicate  with  -  plus  copies  for  your  records. 

•  Complete  the  ISl)  ('<)(  iRIM.VX  I  ION  SHEET  in  duplicate.  Send  one  copy  to  the 
individual  and  attach  one  copy  to  th  package  of  DSP  Sheets. 
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SAMPLE  DSP  SHEET  (front) 


ISD  III- 2  Specify  Management  Plan  and  Delivery  Syetem 

DELIVERY  SYSTEM  PLANNIN6  SHEET 
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LEARNING  CATEGORY  MATRIX-MENTAL  SKILLS 


Identifying  Objects  and  Symbols 


Alternative  Instructional  Delivery  Systems 
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pencil)  in  boxes  repre¬ 
senting  criteria  (rows) 
that  must  be  met 


Delivery  Approaches 
Permitting  the  Application 
of  All  Learning  Guidelines 
and  Algorithm 


Delivery 

Approaches 
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Complete  Apple 
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mg  Guidelines 
and  Algorithm 


Criteria  for  Selecting 
Instructional  Delivery  Systems 


Training  Setting  Criteria 

•  Individual  Trainee  at  a  Fixed 
Location 

•  Individual  Trainee  with  Inde 
pendent  Instruction  at  Any 
Location 
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XXX 


Administrative  Cute'ia 

•  Site  of  Courseware  and  Special 
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LEARNING  CATEGORY  MATRIX-MENTAL  SKILLS 


Recalling  Information 


Directions 
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Delivery  Approaches 
NOT  Permit  ng 
Complete  Application 
of  Learning  Guidelines 
and  Algorithm 
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Training  Setting  Criteria 

•  Individual  Trainees  at  Fixed 
Location 

•  Individual  Trainees  with 
Simultaneous  Instruction  at 
Many  Locations 

•  Individual  Trainees  with 
Independent  Instruction  at 
Any  Location 

•  Small  Group 

•  Large  Group  at  a  Single  Location 

•  Team  Setting 


Administrative  Criteria 

»  Site  of  Courseware  and  Special 
Hardware  Development 
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Central 
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•  Audio 
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Programmed  Text  Linear  with 
Instructor  Scored  Criterion  Test 


LEARNING  CATEGORY  MATRIX-MENTAL  SKILLS 
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Training  Setting  Criteria 
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Appendix  A 

GLOSSARY  OF  INSTRUCTIONAL  DELIVERY  SYSTEMS 


Audio  Only  Systems 

Audio  Disc  Playback  System  -  An  audio  system  that  uses  a  record  player  and  sound 
recorded  on  a  disc  (record)  that  may  be  played  back  upon  request  by  a  listener. 

Audio  Tape  System  -  An  audio  system  that  uses  a  tape  recorder/reproducer  to 
record  sound  on  magnetic  tape  that  may  be  played  back  upon  request  by  a  listener. 
(Reel  to  reel,  cartridge,  cassette). 


Audio-Visual 

Audio  Tape  With  Printed  Material  -  An  audio  system  that  uses  a  tape  recorder/ 
reproducer  to  record  sound  on  magnetic  tape  that  may  be  played  back  upon  request. 
Printed  materials  such  as  texts,  worksheets,  PI,  schematics,  test  materials,  etc.,  used  with 
audio  tapes  offer  a  variety  of  training  applications. 

Classroom  -  Traditional  -  A  classroom  designed  and  equipped  for  an  instructor  to 
lecture,  lead  group  discussions,  conduct  paper  and  pencil  tests  and  use  instructor  con¬ 
trolled  audio-visual  aids. 

Filmstrip  Projection  System  With  Audio  -  A  sound  filmstrip  projector  represents  a 
family  of  audio-visual  devices  using  single  frame  visual  filmstrips  with  sound  on  magnetic 
tape  or  records.  Visuals  and  sound  may  be  manually  or  automatically  synchronized,  or 
be  completely  independent  of  one  another.  Commercial  equipment  options  include  front 
or  rear  screen  projection,  remote  and  stop  action  capability,  and  cartridge  loading  models. 

Filmstrip  Projection  System  With  Audio  and  Adjunct  Equipment  -  A  system  for 
presenting  information  via  a  filmstrip  projector  and  synchronized  audio  tape  or  film 
sound  track.  The  use  of  adjunct  equipment  with  the  AV  media  provides  the  capability 
for  a  variety  of  “hands-on”  training  tasks  to  be  performed. 
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Motion  Picture  Projection  System  -  Commercial,  16MM  and  Super  8MM  Films  • 

A  motion  picture  projection  system  implying  the  use  of  professionally  prepared  commer¬ 
cial  16mm  or  S-8mm  sound  motion  picture  films  for  training.  Appropriate  16mm  or 
S-8mm  projector  and  projection  screen  are  included. 

Motion  Picture  Projection  System  -  Low  Budget  16MM  and  Super  8MM  Films  - 
A  motion  picture  projection  system  implying  the  use  of  locally  produced  sound  motion 
picture  films  for  training.  Such  films  are  acceptable  for  training,  but  often  lack  the  pro¬ 
fessional  quality  of  commercial  films.  Appropriate  16mm  or  S-8mm  projector  and  pro¬ 
jection  screen  are  included. 

Microform  With  Information  Mapping,  and  Audio  -  The  theoretical  configuration 
of  a  training  system  to  support  individualized  instruction  composed  of  microimagery  in 
an  information  map  format,  a  microform  projector,  an  audio  tape  in  a  cassette  and  an 
audio  cassette  playback  unit. 

Instructional  Kit  With  Instructor  -  A  teaching  kit  designed  for  specific  subject  area 
instructional  support.  Kit  allows  the  instructor  to  use  a  varied  or  multi-level  teaching 
strategy  approach  to  instruction  by  including  appropriate  visual  aids,  audio  tapes,  models, 
charts,  demonstrators,  reference  and  test  materials. 

Instructional  Kits  for  Trainees  -  A  modular  instructional  kit  designed  for  students 
that  contains  all  materials  required  for  a  segment  of  instruction.  Kit  may  contain  pro¬ 
grammed  instruction,  audio  visual  materials,  tools,  materials,  typical  samples,  reference 
materials,  and  testing  materials  as  appropriate. 

Overhead  Projection  System  With  Instructor  -  A  system  consisting  of  a  horizontal 
stage  projector  designed  to  use  a  vertical  throw  for  focusing  an  enlarged  transparency 
image  upon  a  projection  screen.  An  operator  is  normally  required  to  change  the 
transparency  and  furnish  verbal  commentary. 

Sound  Slide  Projection  System  -  A  system  for  presenting  information  to  means  of 
an  audio  tape  and  a  series  of  synchronized  projected  visual  slides.  The  use  of  adjunct 
equipment  allows  the  system  to  be  used  in  support  of  “hands-on”  training. 

Teaching  Machine  -  Branching,  Still  Visual  With  Audio  -  An  instruction  device  com¬ 
posed  of  large  step  multiple  choice  programmed  instruction  frames  (still)  with  synchronized 
sound  and  a  manually  controlled  device  to  select,  sequence,  and  display  program  frames 
in  an  order  dependent  upon  the  trainee’s  last  response. 

Teaching  Machine  -  Branching,  Still  and  Motion  Visual  With  Audio  -  An  instruction 
device  composed  of  large  step  multiple  choice  programmed  instruction  frames  (still  and 
motion)  with  synchronized  sound  and  a  manually  controlled  device  to  select,  sequence, 
and  display  program  frames  in  an  order  dependent  upon  the  trainee’s  last  response. 

Teaching  Machine  -  Branching,  With  Adjunct  Equipment  -  An  instruction  device 
composed  of  large  step  multiple  choice  programmed  instruction  frames  (still  or  motion 
with  or  without  audio)  with  a  manually  controlled  device  to  select  sequence  and  display 
program  frames  in  an  order  dependent  upon  the  trainee’s  last  response.  Associated 
with  this  equipment  is  a  second  piece  of  equipment,  such  as  a  mockup,  which  is  the 
subject  of  instruction  and  is  operated  according  to  instructions  from  the  basic  teaching 
machine. 
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Teleconference  System  -  A  telecommunication  system  that  allows  audio  and  visual 
two-way  communication  between  two  or  more  remote  locations. 

Television  -  Cable  (CATV)  -  A  hybrid  CCTV  system  offering  selective,  multiple 
channel,  encoded  programming  to  t  able  network  patrons.  A  typical  system  consists 
of  a  signal  receiving  antenna  system  for  the  master  station  and  relay  of  amplified  signal 
channels  via  area  substations  to  system  subscribers.  Programming  may  also  be  generated 
and  transmitted  between  substations  offering  multiple  options  for  conference  or  training. 
Programs  are  encoded  for  privacy  and  control  of  viewing  audience. 

Television  -  Closed  Circuit  (CCTV)  Without  Feedback  -  CCTV  without  feedback  is 
an  electronic  transmission  system  for  images  and  sound  using  a  coaxial  cable  distribution 
system.  System  design  includes  one  or  more  studios  or  control  rooms,  a  signal  distribu¬ 
tion  center,  and  signal  distribution  cables  terminating  in  reception  areas  equipped  with 
receiver/monitors.  Off  air,  live  or  video  taped  programs  may  be  used. 

Television  -  Portable  Video  Tape  System  -  A  low  cost  video  tape  recording  and 
playback  system  which  is  self-contained  and  portable.  Typical  systems  consist  of  one 
or  two  mobile  vidicon  cameras,  small  scan  video  tape  recorder  (B&W)  and  a  monitor 
received.  Immediate  area  programming  and  open  broadcast  reception  and  recording  is 
standard. 

Carrel  -  AV  Equipped  -  A  small  enclosure  or  alcove  incorporating  a  desk  used  for 
individual  studies,  supplied  with  audio  and  visual  materials  and  supporting  equipment. 

Carrel  -  Laboratory  -  A  small  enclosure  or  alcove  incorporating  a  desk,  to  be  used 
by  one  or  two  trainees  and  equipped  with  a  set  of  special  tools  and  materials  for  carrying 
out  a  hands-on  learning  event.  It  may  include  audio-visual  systems. 

Computer  Assisted  Instruction  (CAI)  -  A  form  of  individualized  instruction  that 
employs  a  digital  computer  technology  to  manage  and  display  information  to  a  student, 
accept  student  responses,  provide  knowledge  of  results,  and  select  subsequent  learning 
events. 

Computer  Assisted  Instruction  -  PLATO  IV  Basic  Configuration  -  An  individualized 
computer  based  teaching  system  being  developed  by  the  University  of  Illinois  at  Urbana- 
Champaign,  and  includes  up  to  4096  terminals,  a  communication  network,  a  central  com¬ 
puter  and  the  author  language  TUTOR. 

Computer  Assisted  Instruction  -  PLATO  IV,  Basic  Configuration  and  Audio  -  System 
includes  basic  configuration  of  PLATO  IV  plus  a  random  access  audio  playback  system. 

Computer  Assisted  Instruction  -  PLATO  IV,  Basic  Configuration  With  Adjunct 
Equipment  -  Includes  the  basic  terminal  with  externally  connected  auxiliary  equipment. 

Computer  Assisted  Instruction  -  PLATO  IV  Basic  Configuration  With  Adjunct 
Equipment  and  Audio  -  The  basic  terminal  with  externally  connected  auxiliary  equipment 
includes  a  random  access  audio  playback  system. 


Computer  ManadK  Instruction  (CMI)  -  A  computer  has  the  required  instructional 
design  program.  It^ran  receive  information  about  the  student  behavior  from  terminals  on- 
or  off-line  and  give  him  information  about  his  achievement.  The  design  normally  gives 
instructors  for  changes  which  are  indicated  by  student  response  and  may  drop  him  to 
ea§iei''exercises  or  automatically  cycle  him  to  a  higher  response  exercise. 

CMI  -  CA1  TICCIT  -  A  system  designed  by  Mitre  Corporation  and  programmed  by 
Utah  State  University  which  can  both  manage  student  instruction  and/or  provide  full 
instruction. 


Computer  Simulation 

Computer  Simulation  -  On-Line  -  A  trainee  station  equipped  with  a  computer  termi¬ 
nal  in  which  the  trainee  operates  in  direct  interface  with  the  computer  as  part  of  the 
program  loop.  By  his  inputs,  the  trainee  determines  his  allowable  performance  parameters 
and  discerns  the  effect  of  his  inputs  upon  the  system  being  simulated. 

Computer  Simulation  -  Off-Line  -  A  trainee  station  equipped  with  a  computer  termi¬ 
nal  enabling  a  trainee  to  select  a  computer  simulation  program,  enter  his  own  variables 
(batch  processing)  and  run  the  simulation  to  determine  the  performance  of  the  simulated 
system  under  a  variety  of  conditions. 

GAME  -  Computer  Simulation,  Solitaire,  With  Visual  Display  -  Any  contest, 
governed  by  rules,  between  a  single  player  and  a  computer  with  visual  attachments  where 
the  contest  is  a  dynamic  model  of  some  real  world  system  or  event. 

Operational  Equipment  With  Manuals  -  A  unit  of  operational  equipment  being  used 
for  instructional  or  training  purposes  with  its  supporting  technical  documentation  such 
as  operator’s  guides,  maintenance  manuals  and  parts  lists.  May  be  an  electronic  black 
box,  rifle,  or  truck.  Usually  associates  with  individual  training  leading  to  team  training. 

Operational  System  -  Real  Environment  -  An  operational  system  used  for  training 
such  as  an  aircraft,  ship,  or  track  vehicle.  Part  task,  in  conjunction  with  or  independent 
of  normal  operations.  A  performance  aid  is  inherent  in  trainer  usage. 

Operational  System  -  Synthetically  Simulated  -  A  device,  machine,  apparatus,  or 
paper  model  that  synthetically  reproduces  a  condition  or  conditions  of  an  operational 
system.  It  may  or  may  not  physically  represent  the  operational  system,  but  will  func¬ 
tionally  allow  an  individual  or  crew  to  practice  operational  tasks  in  accordance  ith 
training  objectives. 

Operational  System  -  Synthetically  Stimulated  -  An  operational  system  that  is  used 
for  training  by  interfacing  input  equipments  in  the  form  of  tapes,  black  boxes,  or  com¬ 
puters.  Such  input  equipments  present  programmed  data  to  the  operational  system 
allowing  it  to  be  used  for  training  or  evaluative  purposes.  May  be  used  for  part  task, 
full  task,  sub-team,  multi-team  training,  or  combinations  thereof.  A  performance  aid  is 
inherent  in  trainer  usage. 


Procedure  Trainer  -  Training  hardware  designed  for  basic  training,  familiarization  or 
transition  type  procedure  training  for  normal,  alternate,  and  emergency  operation  of 
operational  hardware.  Trainer  systems  respond  appropriately  to  trainee  inputs  but  to  a 
lesser  degree  of  fidelity  of  performance  than  is  required  for  simulators.  May  be  used  for 
various  combinations  of  part  task,  full  task,  subteam,  team,  or  multi-team  training. 

Procedure  Trainer  -  Adjunct  Displays  and  Logic  -  Training  hardware  designed  for 
basic  training,  familiarization,  or  transition  type  procedure  training  for  normal,  alternate, 
and  emergency  operation  of  operational  hardware.  Trainer  systems  respond  appropriately 
to  trainee  inputs  but  to  a  lesser  degree  of  fidelity  of  performance  than  is  required  for 
simulators.  May  be  used  for  various  combinations  of  part  task,  full  task,  sub-team, 
team,  or  multi-team  training.  Adjunct  displays  and  logics  may  include  scoring  attach¬ 
ments,  adaptive  control,  automatic  demonstrations,  enhanced  displays,  automated  briefing 
and  debriefing  capability,  automatic  coaching,  remedial  exercise  prescriptions  or  follow-on 
assignments. 

Simulator  -  Training  hardware  that  is  designed  specifically  for  training  purposes  to 
simulate  operational  equipment/systems  or  portions  thereof,  and  which  simulates  the 
operational  environment  in  a  training  situation.  When  operated,  it  becomes  a  dynamic 
model  of  the  appearance  and  performance  of  selected  aspects  of  the  operational 
equipment/system.  May  be  designed  for  part  task,  full  task,  sub-team,  team,  multi-team 
training  or  combinations  thereof. 

Simulator  -  Adjunct  Displays  and  Logic  -  Training  hardware  that  is  designed  specifi¬ 
cally  for  training  purposes  to  simulate  operational  equipment/systems  or  portions  thereof, 
and  which  simulates  the  operational  environment  in  a  training  situation.  When  operated, 
it  becomes  a  dynamic  model  of  the  appearance  and  performance  of  selected  aspects  of 
the  operational  equipment/system.  May  be  designed  for  part  task,  full  task,  sub-team, 
team,  multi-team  training  or  combinations  thereof.  Adjunct  displays  and  logics  may 
include  scoring  attachments,  adaptive  control,  automatic  demonstrations,  enhanced  dis¬ 
plays,  automated  briefing  and  debriefing  capability,  automatic  coaching,  remedial  exer¬ 
cise  prescriptions  or  follow-on  assignments. 

Specimen  Sets  -  An  instructional  kit  containing  samples  of  similar  items,  liquids 
or  materials  that  may  be  tested  or  evaluated  for  identification,  quality  or  type. 

Physiological  Trainer  (Hostile  Environment)  Visual  -  A  training  device  designed  to 
place  controlled  stress  on  the  human  visual  systems,  through  the  use  of  physiologically 
and/or  psychologically  adverse  or  low  threshold  visual  signals,  to  enable  a  trainee  to 
learn  to  function  in  this  adverse  environment. 

Physiological  Trainer  (Hostile  Environment;  Surface  and  Internal  Senses  -  A  broad 
category  of  training  devices  designed  to  provide  the  cutaneous,  kinesthetic,  and  olfactory 
sensors  with  pnysiologically  and/or  psychologically  adverse  signals,  to  enable  a  trainee  to 
function  in  adverse  pressure,  temperature,  pain,  or  disorientating  motion  environments. 


Visual  Only 

Filmstrip  Projection  System  -  A  single  frame  projector  or  attachment  thereto  that 
will  accept  a  filmstrip  format  and  project  the  film  images  upon  a  viewing  screen.  See: 
Sound  Filmstrip  Projection  System. 


Microform  With  Information  Mapping  -  Micro-imagery,  such  as  microfilm,  used  as  a 
medium  of  introduction  with  the  additional  requirement  that  each  block  of  information 
be  clearly  identified  as  introduction,  overview,  test,  review  questions,  index,  and  other 
discrete  titles,  and  that  each  type  of  information  be  positioned  in  a  standard  location 
within  the  medium  format. 

Microform  With  Information  Mapping  and  Adjunct  Equipment  -  The  theoretical 
configuration  of  a  training  system  to  support  individualized  instruction  composed  of 
microimagery  in  an  information  map  format,  a  microform  projector,  and  a  piece  of 
auxiliary  equipment,  such  as  a  mockup,  which  is  the  subject  of  the  instruction. 

Slide  Projector  System  -  2”  x  2”  -  A  class  of  single  frame  picture  projectors  that 
will  accept  a  standard  2”  x  2”  slide  and  project  the  contained  image  upon  a  viewing 
screen. 

Simulation  -  Paper  -  The  representation  of  selected  dynamic  characteristics  of  a 
system  through  the  use  of  charts,  tables,  static  photographs,  drawings,  and  lists  of  per¬ 
formance  characteristics  under  specified  conditions.  This  information  is  presented  in 
such  a  way  that  the  trainee  can  study  the  initial  performance  of  the  system,  change 
inputs  to  or  elements  within  the  system  and  note  changes  in  the  performance  of  the 
system. 

Teaching  Machine  -  Linear,  Still  Visual  -  An  individualized  instruction  system  com¬ 
posed  of  a  fixed  linear  sequence  of  small  step  programmed  instruction  frames  (still) 
and  a  manually  controlled  device  to  display  the  information. 

Teaching  Machine  -  Branching,  Still  Visual  -  An  individualized  instruction  system 
composed  of  large  step  multiple  choice  programmed  instruction  frames  (still)  and  a 
manually  controlled  device,  to  select  sequence  and  display  program  frames  in  an  order 
dependent  upon  the  trainee’s  last  response. 


Print  Materials 

Case  Study  Folder  -  A  folder  of  detailed  background  information  on  a  problem 
requiring  a  decision  or  plan  of  action;  to  be  read  by  the  trainee  prior  to  his  (1)  making 
a  decision  on  how  to  resolve  the  issue,  and  (2)  participating  in  a  critique  on  various  solu¬ 
tions.  Various  forms  of  folders  are  used  in  support  of  such  methods  of  instruction  as 
the  Case  Study,  Incident  and  In-Basket  methods  of  management  and  leadership  training. 

Flash  Cards  -  A  set  of  cards  designed  to  be  used  by  an  instructor  in  front  of  a  group 
of  trainees  to  drill  the  group  in  the  recall  of  memory  type  information. 

Printed  Materials  -  Handouts  -  Handouts  are  a  class  of  printed  materials  issued  to 
a  student  for  his  use  and  retention  to  augment  regular  instructional  materials.  They  are 
usually  instructor  prepared,  machine  copied  materials  of  one  or  two  pages  highlighting 
specific  topics  or  updating  existing  materials. 

Printed  Materials  -  Performance  Aids  -  Performance  aids  are  a  class  of  printed 
materials  that  aid  in  job  performance  by  providing  data  that  should  not  be  committed 
to  memory,  such  as  checklist  routines,  tables,  equipment  test  tolerance  matrices,  and 
the  like. 
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Printed  Materials  -  Reference  Books  -  Reference  books  are  a  class  of  printed  materials 
used  to  identify  certain  facts  or  for  background  information  such  as  dictionaries,  encyclo¬ 
pedias  or  technical  poublications. 

Printed  Materials  -  Reference  Charts  -  Reference  charts  are  a  class  of  printed  material 
pictorially  or  geographically  displaying  data  used  to  identify  certain  facts  or  for  back¬ 
ground  information.  Included  are  data  charts,  schematic  diagrams,  topographical  maps, 
and  the  like. 

Printed  Materials  -  Self  Scoring  Exercises  -  Self  scoring  materials  include  exercises 
and  quizzes  used  in  conjunction  with  standard  curriculum,  programmed  instruction  or 
independently.  The  class  includes  electrographic  or  mark  sense  materials  scored  by  keys 
or  computer,  punch  mark  and  other  mechanical  score  indicating  equipments,  chemically 
scored  materials,  etc.  that  have  the  capability  of  providing  near  immediate  student  feed¬ 
back  without  the  use  of  prolonged  scoring  procedures. 

Printed  Material  -  Workbook  -  Workbooks  are  a  class  of  printed  material  used  to 
augment  or  replace  regular  instructional  texts  by  providing  a  mix  of  text  information 
and  practice  exercises  within  a  single  book  or  manual. 

Printed  Material  -  Textbook  -  Textbooks  are  a  class  of  printed  material  dealing  with 
a  subject  of  study,  intended  for  use  at  a  specified  level  of  instruction  and  used  as  a 
principal  source  of  study. 

Programmed  Text  -  Branching  -  A  printed  text  containing  frames  of  information 
and  multiple  choice  questions  concerning  the  information,  organized  in  such  a  way  that 
the  trainee’s  choice  of  response  directs  him  to  remedial  frames  or  advanced  material,  as 
appropriate.  The  material  is  carefully  sequenced,  tested,  and  revised  to  ensure  that  a 
specific  student  population  will  achieve  stated  behavioral  objectives  with  a  predetermined 
level  of  success. 

Programmed  Text  -  Branching  With  Adjunct  Material/Equipment  -  Used  with  adjunct 
materials  or  equipment,  a  wide  range  of  training  application  is  available. 

Programmed  Text  -  Linear  -  A  printed  text  containing  a  fixed  sequence  of  small 
frames  of  information  usually  in  the  form  of  questions  requiring  the  trainee  to  construct 
a  simple  written  response,  which  is  immediately  evaluated.  The  material  is  carefully 
sequenced,  tested,  and  revised  to  ensure  that  a  specific  student  population  will  achieve 
stated  behavioral  objectives  with  a  predetermined  level  of  success. 

Programmed  Text  -  Linear  With  Adjunct  Material/Equipment  -  Used  with  adjunct 
material  or  equipment,  a  wide  variety  of  training  application  is  available. 

Study  Card  Sets  -  A  deck  or  decks  of  cards  designed  to  present  training  information 
to  an  individual  student. 
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Special  and  Non-Standard  Items 


Automatic  Raters  -  Informal  Training  -  A  class  of  electro-mechanical  response  rating 
devices  used  primarily  for  informal  refresher  type  training.  Typically,  a  gaming  approach 
is  used  to  offer  multiple  choice  type  questions  to  the  trainee.  Immediate  feedback  upon 
answer  choice  selection  is  given  in  the  form  of  right,  wrong,  or  item  score  as  well  as 
cumulative  score. 

Carrel  -  Dry  -  A  small  enclosure  or  alcove  incorporating  a  desk,  used  for  individual 
studies,  without  audio-visual  or  laboratoiy  equipment. 

Do-It-Yourself  Kits  -  A  type  of  instructional  kit  containing  instructions  and  materials 
for  fabricating  a  usable  product.  Such  a  kit  offers  practical  “hands-on”  training  following 
theoretical  training. 

Game-Manual  Simulation  -  Any  contest  between  teams  or  individual  players, 
governed  by  rules,  where  the  contest  is  a  dynamic  model  of  some  real  system,  and  is 
played  without  the  aid  of  a  computer  using  gaming  techniques. 

Game  -  Manual  Non-Limulation  -  Any  contest  between  teams  or  individual  players, 
governed  by  rules,  where  the  contest  is  not  a  dynamic  model  of  some  real  system,  and 
is  played  without  the  aid  of  a  computer. 

Game  -  Computer  Supported  Simulation  -  Any  contest,  governe  '  by  rules,  between 
teams  or  individuals,  where  the  contest  is  a  dynamic  model  of  some  real  system,  and 
a  computer  is  used  in  performing  some  of  the  calculations  necessary  for  the  operation 
of  the  model  as  in  computer  supported  war  gaming. 

Logic  Trainers  -  A  class  of  trainers  that  synthetically  allow  electronic,  mechanical, 
fluid,  or  gaseous  conceptual  system  logic  training  without  the  use  of  actual  hardware. 

Mockups,  Panels,  and  Demonstrators  -  Dynamic  -  A  visual  training  aid  that  allows 
an  instructor  to  demonstrate  manipulative  principle,  movement  in  time  or  space,  steps 
of  a  procedure,  linear  effect  within  systems  or  changes  in  condition  of  equipment  or 
systems  through  one  or  more  operating  phases. 

Models  and  Static  Mockups  -  Small  Scale  -  A  three-dimensional  training  aid  built 
to  scale  and  representing  operational  equipment.  It  may  be  a  solid  or  cutaway  model 
capable  of  disassembly  by  which  spatial  and/or  sequential  relationships  are  represented. 
Also  included  are  layout  models,  recognition  model  sets,  and  terrain  or  topographical 
models. 

Mockups,  Panels,  and  Demonstrators  -  Static  -  A  training  aid  used  to  demonstrate 
relative  shape,  size,  composition  or  function  of  an  object  or  system  by  a  visual-cognitive 
process  performed  by  the  trainee.  Such  non-moving,  real  or  “scaled”  aids  include  cut¬ 
away  models,  diagrams,  blow-apart  hardware  displays,  etc. 
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JOB  AID  FOR 

REVIEW  AND  SELECTION  OF  EXISTING  MATERIAL 


ISD  III .3 


Manual 


This  is  the  11th  in  a  series  of  ISD  Job  Aids  for  use  in  instructional  design  and 
uevelopment.  This  volume  is  to  be  used  as  a  supplement  to  the  primary  document 
“Job  Aids:  Descriptive  Authoring  Flowcharts  ISD  III. 3  Review  and  Select  Existing 
Material.”  The  flowchart  document  will  direct  you  to  specific  guidance,  examples, 
and  references  provided  in  this  volume.  If  you  do  not  have  the  primary  flowchart 
document,  request  it  from  your  supervisor. 


ISO  1 1 1.3  Review/Select  Existing  Material 
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from  block  1  and  2 


to  block  6 


What  it>  the  Re.vi.ew  and  Seiectiun  ofi  Existing  l\otetiaJU> 
Job  Aid  aJUL  about? 

•  GOAL 

The  purpose  of  this  job  aid  is  to  help  you  evaluate  existing  materials  in  order  to 
determine  their  usefulness  in  your  training  program. 

Since  the  cost  of  developing  new  materials  is  so  high,  your  goal  is  to  retain  as 
many  existing  materials  as  possible.  These  can  be  incorporated  into  a  new 
course  just  as  they  are,  or  after  revisions  have  been  made. 


•  OBJECTIVES 

1.  Given  a  set  of  existing  materials,  analyze  the  materials  to  determine  if  the 
materials,  parts  of  the  materials,  or  revised  versions  of  the  materials  will  be 
useful  for  the  instruction  you  are  developing. 

2.  Given  the  appropriate  worksheets  and  instructions  for  filling  them  out, 
document  the  materials  examined  and  the  outcome  of  the  examination. 


•  PRODUCTS 

This  job  aid  will  result  in  a  list  of  all  existing  materials  which  have  been  con¬ 
sidered  for  use  in  your  course  development  activity.  Each  item  of  material  is 
evaluated  as  to  whether  it  should  be  accepted  or  rejected  for  use  in  your  course. 

If  the  material  is  to  be  accepted  suggestions  for  revisions  (if  needed)  are  documented. 
Each  item  is  therefore  classified  as: 

a)  accept  for  use  without  revision 

b)  revise  for  use 

c)  reject 
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•  OVERVIEW  OF  MAJOR  STEPS  IN  REVIEWING  AND  SELECTING 
EXISTING  MATERIALS 

Step  1.  Identify  potentially  useful  materials  from  sources  such  as: 

a.  references  identified  in  the  job  aid  (listed  on  Reference  Review 
Sheet  A) 

b.  DA  Pam  611-11  or  611-12 

c.  supervisors 

d.  other  subject  matter  experts 

e.  your  own  personal  experience  in  the  area 
Step  2.  Obtain  references 

Step  3,  Identify  and  record  specific  items  of  material  identified  in  the  references 

Step  4.  Examine  each  item  of  material  in  terms  of  how  well  it  matches  with: 

a.  trainee  characteristics 

b.  learning  guidelines 

c.  proposed  delivery  system 

d.  proposed  management  plan 

Step  5.  If  examination  indicates  material  is  useful  but  would  require  revision, 

consider  whether  revisions  would  be  less  costly  to  make  than  to  develop 
new  material. 

Step  6.  On  the  basis  of  Steps  4  and  5,  above,  determine  and  record  whether 
items  of  material  should  be: 

a.  accepted  as  is 

b.  rejected  completely 

c.  revised— specific  suggestions  for  revision  are  recorded 
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WORKSHEETS  USED 


—  The  tables  on  page  K-7  thru  K-10  are  samples  of  Rel  ;rence  Review  Sheet  A 
(front  and  back)  and  Reference  Review  Sheet  B  (front  and  back).  The  front 
side  of  Sheet  A  and  both  sides  of  Sheet  B  have  been  filled  in  to  show  how 
the  forms  look  when  completed. 


DESCRIPTIVE  FLOWCHARTS 

—  The  flowchart  on  pages  K-46  and  K-47  shows  the  steps  in  the  use  of  the  Job 
Aid  for  Review  and  Selecting  Existing  Materials.  The  flowchart  will  be  useful 
to  you  in  getting  a  clear  picture  of  the  overall  process  used  in  this  job  aid.  A 
more  completely  described  flowchart  is  provided  in  Job  Aids:  Descriptive 
Authoring  Flowcharts,  (ISD  III.3  Review /Select  Existing  Material). 


Table  K-7 

Completed  Reference  Review  Sheet  A  (Front  Side) 

ISD  III  3  Review /Select  Existing  Materials 

REFERENCE  REVIEW  SHEET  A 


MOS  Code _ l3_tL . . . 

Skill  Level _ / _ _ 

Instruction  Under  Oevelnoment  1—  Ajn  A  A/g*i 


o.t.  u/HJli 


SECTION  I  Army  References 

Present  Army  Coursels)  hi  any  I 


Comb**  Sk.  illj  f**  In  tan  try  m** _ _ 


Army  References  to  be  Examined  C 

Announcement  of  U  S  Army  Correspondence  Courses  DA  Pam  351  ?Q 
Army  Correspondence  Course  Program  La  Pam  350  2 
Index  of  U  5  Army  Motion  P'Clutes  0 A  Pam  105  I 

Interserwte  form*.  School  Training  1  or  DO  0  C-vil-an  and  Military  Personnel  Army  fteguladun  351  9  Ot/f 

USAF I  Correspondence  Courses  OA  Pam  350  6 

Bibliography  ol  Tethi  cal  Manuals  TM3104 

Bibliography  of  field  Manuals  TM310  2 

TEC  Manual 

.Xndi^zit  -  A2.Q_~-2LX~  5 IQ7  Qk+ 

70  -  ' ! 7^7  .. 


SECTION  II  References  from  Other  Services  to  be  Examined 

Occupational  Specialty  Code  An  force }/on£^~  *Vai.y  _  M  i«-  QZ// 

Comments 

C&t&l °i  *4  Naum  Trgj'nifij  Course!  -  A/A\/£j}TR4  /QSQO 
ft *rt Jit.  Fo^ntf  ScJ***!  CcJ-tha  -  ftCO  ~Pf^Oo 

Si&rtAi.  Corps  Tttf+i+v-r*,  Handbook  ft  to  *  P17S&  )H 

— 

SECTION  III  Other  References  to  be  Examined 

Comments 
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Table  K-9 


Table  K-10 


from  block  4  and  5 


Identify  the  Tyne  of 
Instruction  You  Have 
Been  Assigned  to 
Develop 


to  block  7 


•  Types  of  instruction  mey  include 

-  a  complete  resident  course 

-  a  correspondence  course 
one  or  more  lessons 

•  For  further  guidance,  see  below 


one  or  more  modules 
•  TEC  lesson 
etc 


Why  the.  type,  ofi  tvu>tn.u.ctLon  tmpositcLnt? 

•  Prior  to  the  actual  identification  and  examination  of  potentially  useful  items  of 
instruction  material  it  is  important  for  you  to  have  a  clear  picture  of  the  type  of 
instruction  that  is  to  be  developed.  This  will  include  such  things  as: 

a.  A  list  of  the  tasks  to  be  included  in  the  instruction 

b.  Job  performance  measures  (performance  descriptions) 

c.  Clearly  stated  learning  objectives  for  each  task 

d.  An  understanding  of  the  entry  characteristics  of  the  student  population 

e.  What  delivery  system(s)  is  to  be  used  for  the  instruction  (e.g.,  lecture, 
demonstration,  TEC  lesson,  film  strip,  etc.) 

f.  Etc. 


•  After  identifying  the  type  of  instruction  that  is  to  be  developed  and  obtaining 
a  clear  picture  of  what  it  should  include,  you  are  ready  to  begin  searching  for 
materials  that  may  be  useful,  with  or  without  modification,  in  the  instructional 
development  process. 


K 


from  block  6 


to  block  9 


•  Reference  Review  SAeeii  are  t  untamed  m  puckei  at  in«  back  at  Manual 

•  for  exampla  ol  whal  completed  fifl  Sheet  A  looks  like  see  Manual 
pep  K  7  and  K  8 


•  6  sample  set  below 


What  doet  RR  Sheet  A  look  tike  when  Identifying 
Information  ha6  been  n.eeofided ? 

Example: 


ISD  III  3  Review /Select  Existing  Materials 


REFERENCE  REVIEW  SHEET  A 

~™"~  Irjt- 


MOS  Code  /5  H 

Skill  Lwel  / 


' - L - - - - 

Instruction  Under  Development  Lfl^r\ri  i  <y*.+fQn  (a*  Tn  fan  -tryfQJk* 


Pete  ////Y/  72 

Your  Name  5 FC  JoAt 


SECTION  I  Army  HeTerencei 


Preedit  Army  Course!*)  lit  any]_ 


Army  References  to  be  Examined 
Announcement  of  U  S  Army  Correspondence  Corses  -  OA  Pam  351  20 
Army  Correspondence  Course  Program  QA  Pjm  350  2 
Indei  of  U  S  Army  Mol-on  piriures  OA  Pam  108  1 


Comment* 


imerwrvite  forma'  School  training  lor  ODD  Civilian  and  Military  Personnel  Army  Regulation  3b T  9 
USAf  i  Correspondence  Courses  OA  Pam  350  6 
S'D'iugraphy  ol  Technic*)  Manuals  TM3I0  4 
Bibliography  ol  field  Manuals  TM310  2 


TEC  Manual 


<<♦"  Wjney 


to  block  10 


dlhcU  dooA  RR  Sko.oX  A  look  like  u)ko.n  the.  name  U) 
ofi  pn.zAQ.vit  C.01MAQ.U)  <u>  n.o.c.on.do.d  In  Szction  l? 


Example: 


ISD  III  3  Review /Select  Existing  Materials 

REFERENCE  review  sheet  a 


IRR  Sheet  A) 


from  block  9 


Identity /Record  Other 
Aimy  Reference 
Materials 

(Section  I.  HR  Sheet  Al 


to  block  1 1 


•  RR  Sheet  A  includes  standard  Army  references  that  should  be  examined 

•  Any  additional  sources  ot  appropriate  Army  material  are  added  to  Seciion  1  ot 
RR  Sheet  A 

•  For  help  m  identifying  am  i-curding  additional  sources  ot  Army  material, 
see  below 


Hou)  do  I  Zde.wtL&y  and  >uLc.on.d  knmy  A.e.tfeAe.nce  maXeAviCA? 

•  Identifying  Army  References  Materials: 

There  are  standard  references  that  should  be  checked  in  order  to  identify 
material  related  to  the  tasks  to  be  included  in  the  instructional  material  you 
are  developing.  These  references  are  shown  in  Section  I  of  the  Reference 
Review  Sheet  A.  These  references  should  certainly  be  examined.  Other  sources 
of  potentially  useful  materials  will  include: 

a.  instructional  materials  used  for  other  Army  MpSs  which  may  include  tasks 
similar  to  the  ones  for  which  you  are  developing  instruction.  Check  with 
personnel  working  in  these  similar  MOSs  to  identify  potentially  useful 
material. 

b.  your  supervisor,  peers,  or  your  own  past  experiences. 

•  Recording  Army  References: 

—  Space  has  been  provided  on  RR  Sheet  A  in  Section  1  for  recording  other 
Army  references.  If  additional  space  is  required  use  the  back  side  of 
RR  Sheet  A. 


What  doet>  R efaenenee  Rev-ceu>  Sheet  A  £oofc  -Lcfee  a^toA 
A fumy  nehesieneu  have  been  neeon.ded? 

Example: 


ISD  III  3  Review /Se  lect  Existing  Materials 


REFERENCE  REVIEW  SHEET  A 

(RR  Sheet  A) 


MOS  Coda  /?  H  _ _ _ 

Skill  Laval _ l _ _ 

IrwtfoctKK'  Under  development  L  €Jnd  A/m.u  l  0*1  ^*r 


_ o  »««_.////*/?/ 


SECTION  I  Army  References 

Preaent  Army  Course!*)  (if  any  I  C  Om  Skif/s  of  Sefji+r 


Army  References  to  be  Examined 
Announcement  of  U  S  Army  Correspondence  Courses  DA  Pam  351  20 
Army  Correspondence  Course  Program  DA  Pam  350  7 
Index  ol  U  S  Army  Motion  Picture*  -  DA  Pam  108  1 
Intenervice  Formal  School  Training  lor  ODD  Civilian  and  Military  Personnel  Army  Regulation  351 
USAFI  Corretpandence  Courses  DA  P»m  350  5 
SiMiogtaphy  of  Technical  Manuals  TM310  4 
Bibliography  of  Field  Manuals  TM3’ J  2 
TIC  Manual 


LXrt dir  tit  Xif#nfir)i*"Art  -  AZO  •  Si  o'} 

1  S S*<viv*4.  7W*  *i'f  m  -  H  TP  -  H *P  •  H 7p 2 


SECTION  II  Raftrance*  from  Ottser  Services  to  be  Examine*4 
Occupational  Specialty  Curie  A.r  Force _  * 


from  block  10 


ObUin  DA  P»m  61 1  1 1 
ODD  Occupational 
Conviroon  Tabl* 


to  block  12 


•  DA  Pam  61 1  11  provide*  decenary  information  lor  converting  Army  60S'* 
into  An  Force.  Navy,  and  Marine  equivalent*. 

•  DA  P»m  61 1  11  replace*  DA  Pam  611  12  It  611  11  i*  nut  available. 

DA  Pam  61  M2  can  be  uted 

•  For  further  t  iplananon.  tee  below. 


What  t&  VA  Pam  611-11  and  wheAe.  can  I  filnd  tt? 


•  The  DoD  Occupational  Conversion  Table  is  a  compilation  of  all  enlisted  occupa¬ 
tional  specialities  in  use  in  the  Armed  Services,  arranged  under  common  DoD 
occupational  groupings  and  a  numerical  coding  system. 

•  DA  Pam  611-11  Department  of  Defense  (DoD)  Occupational  Conversion  Table  is 
available  through  your  supervisor,  MOS  library,  or  school  library.* 


Why  u,  VA  Pam  611-11  important? 

•  If  an  occupational  specialty  appears  under  one  or  more  services,  you  can  be 
almost  certain  that  those  services  have  an  appropriate  training  program  for 
that  specialty. 

•  If  training  programs  exist  for  that  specialty,  then  training  materials  also  exist 
for  those  programs. 

•  Training  materials  that  other  services  provide  may  be  of  use  to  you,  therefore, 
DA  Pam  611-11  is  important. 


*DA  Pam  611-11  replaces  DA  Pam  611-12.  If  611-11  is  not  available,  DA  Pam  611-12 
can  be  used. 


K-16 


1 

I 


from  blocks  12  and  13 


Examine  DA  Pam  611  11 
co  Identity  Any  Serwace(s) 
With  Occupational 
Specialty  Similar  to 
A/my  MOS 


to  block  15 


from  block  14 


“  .  _i _ 

Recoid  Occupational 
Specialty  Codes  lor  Other 
Services 

It  None.  Recurd  ’’None'' 
[Section  1.  RR  Siieet  A) 


i 

to  block  17 


•  This  code  designation  will  a  d  in  tht  later 
search  lor  appropriate  materials  from 
other  services 

*  Example  see  below 


What  dooj>  RR  She.et  A  look  tike,  whzn  occ.tipatA.onaZ 
Ape.ctaZty  codu  ion.  otheA  t>ejivlceA  have.  bee.n 
n.e.con.de.d? 

Example: 


K-19 


from  block  15 


from  block  16 


WheAe.  d n  l  fisind  tke.  A&h<LAmc.eA  ho  a  othoA  aqavac.& 6 
vjyUth.  biniihv i  occapcutlonuZ  tptLCMiltitu,'! 

•  Identifying  References  from  Other  Armed  Services: 

A  partial  list  of  standard  references  from  other  services  is  provided  below: 


SOURCES  OF  TRAINING  COURSES  AND  INSTRUCTIONAL  MATERIALS 

Air  Force 

Extension  Institute  Catalog  and  Guide.  ECIRP  50-1.  Extension  Course  Institute 
Air  University,  Gunter  Air  Force  Station,  Alabama,  1974. 

Instructor’s  Guide  to  Survival  lining  Films.  ADTIC-PUB-G-111.  Arctic-Desert- 
Tropic  Information  Center,  Air  University,  Maxwell  Air  Force  Base,  Alabama. 

Mather  Air  Force  Base  Learning  Center  Catalog.  Headquarters,  323d  Flying 
Training  Wing,  Mather  Air  Force  Base,  California,  95655,  1973. 

USAF  Formal  Schools  Catalog.  AFM  50-5.  Headquarters,  U.S.  Air  Force, 
Washington,  D.C.,  20330,  1973. 

NOTE:  Additional  Sources  comprise  USAF  Study  Reference  Lists,  Specialty 
Training  Standards,  and  Career  Development  Courses. 


Marines 

Basic  School  Extension  Catalog.  Director,  Extension  School,  Education  Center, 
•ICDEC,  Quantico,  Virginia,  22134. 

Marine  Corps  Formal  School  Catalog.  MCO-P1500.12F.  Headquarters,  United 
States  Marine  Corps,  Washington,  D.C.,  1973. 

Marine  Corjjs  Institute  Handbook  (12th  Edition).  MCO-P1550.1H.  Director,  Marine 
•  reunite.  Marine  Barracks,  Box  1775,  Washington,  D.C.,  1973. 


Navy 

Catalog  of  Navy  Training  Courses  ( Vols.  I,  II,  and  III).  NAVEDTRA  10500. 
Chief  of  Naval  Education  and  Training  Support,  Pensacola,  Florida,  32508,  1974. 

Documentary  Film  Catalog  (Revision  No.  1).  NWC-TP-4784-REV-1.  Commander, 
Naval  Weapons  Center,  Cuwa  Lake,  California,  93555,  1971. 

Films  on  Oceanography.  Catalog  Series,  NODC-C-4.  U.S.  Naval  Oceanographic 
Data  Center,  Washington,  D.C.,  20390,  1963. 

Motion  Picture  Catalog  of  Films  Available  Through  the  External  Relations 
Group  Motion  Picture  Project.  TG-533A.  Commander,  Naval  Air  Systems 
Command,  Washington,  D.C.,  20360.  Attention:  AIR-604A1,  1966. 

Wkcut  do<u>  RR  She.eX  A  took  tike.  a^teA  sizfieAence^ 

^n.om  otheA  AeAvtceA  have,  been  sie.coA.ded? 

Example: 


K-21 


'Pvi 


from  blocks  15  and  17 


Identity 'Record  Appro 
pruie  Reference*  Fi  m 
Other  Sources 


1  Section  3.  RR  Sheet  A! 


to  block  19 


•  For  a  list  ol  potential  references  and  guidance  in  recording  same,  we  below 


How;  do  I  idznti&y  and  tizcosid  n.nloA<inc.&>  ^fiom 

Othe A  40UAC&6? 

•  Identifying  References  From  Other  Sources: 

—  A  partial  list  of  references  from  other  sources  (e.g.,  government,  civilian,  etc.) 
is  provided  below: 


OTHER  FEDERAL  GOVERNMENT  SOURCES 

Educational  Resources  Information  Center  (ERIC),  National  Center  for  Educational 
Communication,  400  Maryland  Avenue,  Southwest,  Washington,  D.C.,  20202. 

National  Referral  Center  for  Science  and  Technology,  Library  of  Congress,  First 
and  Independence  Avenue,  Southeast,  Washington,  D.C.,  20540. 

Report  Bibliography.  Defense  Documentation  Center,  Defense  Supply  Agency, 
Cameron  Station,  Alexandria,  Virginia,  22314. 

U.S.  Government  Films:  A  Catalog  of  Motion  Pictures  and  Filmstrips  for  Sale  by 
the  National  Audio  Visual  Center.  National  Archives  Publication  No.  70-3. 
National  Archives,  Washington,  D.C. 


OTHER  GENERAL  SOURCES 

Directory  of  Educational  Information  Resources.  Com  Information  Corporation, 
New  York,  1971. 

ERIC  Document  Reproduction  Service  fEDRSi.  Leasco  Information  Products, 
4827  Rugby  Avenue,  Bethesda,  Maryland,  20014. 

ERIC  Clearinghouse  on  Educational  Media  and  Technology.  Institute  for  Com¬ 
munication  Research,  Stanford  University,  Stanford,  California,  94306. 

Educator’s  Purchasing  Masters  (Vol.  I).  Instructional  Materials,  Fisher  Pub¬ 
lishing  Co.,  Englewood,  Colorado,  1971. 

New  Educational  Materials,  1970.  Cit  lion  Press,  New  York,  1970. 


K-22 


3 


w 


from  block  18 


•  When  all  the  possible  tele  renew  have  been  added  10  RR  Sheet  A.  >1  <;  reviewed 
to  we  it  all  potential  source*  have  been  tapped 

•  Source*  lor  review  would  include  supervisor  peers  and  or  instructors 


to  block  20 


from  block  19 


•  Matenii(s)  may  consist  o<  films,  tape*, 
textbooks,  graphs.  pictures,  over  hear# 
p>  injections,  etc 

•  For  guidance  in  obtaining  materials. 

«•'  below 


How  do  1  obtain  tko,  mateAiati  om  an  zxiAting 
cou/L&e.  fioA.  tfvu  MOS? 

•  Materials  may  be  obtained  through  your  supervisor,  MOS  library,  or  school 
library. 

•  Obtain  all  the  materials  (e.g.,  textbooks,  films,  tapes,  graphs,  etc.)  from  the 
corn  je  and  hold  for  further  evaluation. 

•  Remember,  the  purpose  of  this  job  aid  is  to: 


Retain  as  many  existing  materials  as  possible! 


•  Thus,  the  best  place  to  start  is  with  material  that  has  already  been  used  in  a 
course  designed  to  train  soldiers  for  this  MOS. 


K-25 


from  blocks  20  and  21 


Obtain  Alt  Relaf«nc« 
Racoided  on  HR  Shatt  A 


•  For  guidance  m  obtaining  leteiences.  tee  below 


to  block  23 


How  do  I  obtain  ALL  ae.&eAe.nceA  aeeoaded  on 
RR  Sheet  A? 

•  These  references  may  also  be  obtained  through  your  supervisor,  MOS  library,  or 
school  library. 

•  Some  references  may  be  more  easily  obtained  than  others.  For  instance,  you 
should  be  able  to  obtain  Army  references  in  a  short  amount  of  time.  References 
from  other  services  or  other  sources  may  take  longer. 

•  Obtain  all  those  references  that  are  available  in  a  reasonable  amount  of  time 
(e.g.,  4-6  weeks). 


from  block  22 


No 


Yes 

24 


•  The  reason  f o*  unavailability  is  recorded  to 
that  someone  else  working  on  this  block  m 
the  future  Mill  not  wu Me  time  looking  lor 
references  that  are  no  longer  it,  print,  etc 

•  Example  see  below 


to  block  25 


Record  Reason  tor 
Unavailability 

l  Record  Under  "Com 
menu".  RR  Sheet  A) 


Whcut  dooj>  RR  ShaoX  A  look  tik<L  cifiteA  the.  A&uon 
^ofi  imavaJMibltuty  Ia  h-dcofidud? 

Example: 


ISD  III  3  Review/Select  Existing  Materials 

REFERENCE  REVIEW  SHEET  A 


“OS  Cod,  ft  H 

Skill  M _ (_ 


Initroctioo  Undw  DwdgpiiW't/.to.  A/d.  Yl  ^  dd.  aw 


d.i.  nj/i/i} 
Your  N.m.  SFC  \ 


SECTION  I:  Army  References 

Preeent  Army  Courselsl  {if  any).  £geim:  Ski  Ik  *+  -ti\K _ S&lAi&t 


Army  References  to  be  Examined 


Announcement  ol  U  S  Army  Coirespondence  Courses  -  OA  Pam  351  20 


Army  Correspondence  Course  Program  DA  Pam  350  2 
Index  of  U  S  Army  Motion  Pictures  DA  Pam  1081 
Imerservice  formal  School  Training  to>  D00  Civilian  and  Military  Personnel  -  Army  Regulation  351 
USAFI  Correspondence  Courses  DA  Pam  350  6 
Bibliography  of  Technical  Manua  T  M3 1 0  4 
Bibliography  of  Field  Mams  H  I  M3 10  2 
TEC  Manual 

)  Ftf%  XnftntrjmA*.  • 

SiArWyfrf  -JiTQ  'HHOlTZl 


SECTION  II  Refer »nces  from  Other  Services  to  be  Examined 
Occupational  Specialty  Code  Air  Force _ Navy _ 


-5»vi  ,riUL 


1 


from  blocks  23  and  24 

2b 

flic  cud  ON  flR  SHEET  B 
f  uu/Ntxt  Available 
Retinnce 

I  Col  1.  RR  Sheet  Bi 


to  block  26 


•  Thu  block  begins  the  process  ol  identifying  materials  for  appi  opr  lateness  to  the 
instruction  bemg  developed 

•  Work  is  now  being  done  on  RR  Sheet  B  The  following  is  also  recorded 

-  MOSCode  Date 

-  Skill  Level  -  Your  name 

•  Example  tee  below 


What  doe*  RR  Sheet  B  look  like  after  the  Identifica¬ 
tion  information  and  a  reference  have  been  recorded? 

Example: 

p»y  /  of  /  Rapes 


ISD  III  3  Review/Select  Existing  Material 

REFERENCE  REVIEW  SHEET  B 


(HR  Sheet  B) 


from  block  25 


I 


•  n«»Bf*nc«  are  of  two  type 

1)  Catalogs/int1«xes,  etc  thne  contain  only 
detcnptiont  of  material  which  will  be  obtained 
later 

2)  Items  of  actual  material:  which  will  be  examined 
later. 


how  to  find  material  m  reference  source,  see  below 


to  block  28 


What  anz  ”  appropriate."  mtntzb  and  koto  do  I 
look  them  up? 

•  Appropriateness  of  Entry: 

—  Appropriateness  of  the  entry  is  based  on  the  description  of  the  material  that 
is  given  in  the  catalog. 

—  In  order  to  judge  the  appropriateness  of  a  piece  of  material  from  the  descrip¬ 
tion  given,  ask  yourself  the  following  types  of  questions: 

1)  From  the  description  given,  does  the  piece  of  material  seem  capable 
of  conveying  the  information  that  you  need  to  teach  one  or  more 
tasks  in  your  course? 

—  For  instance,  suppose  the  MOS  is  “Military  Police,”  then  the  following 
description  of  a  film  may  suggest  a  piece  of  material  that  initially 
seems  appropriate. 

“TF  19-1806  Military  Police  Support  in  Amphibious 
Operations  (B&W— 14  mir>— 1953)  Depicts  the  duties  and 
functions  of  the  military  police  in  support  of  a  com¬ 
bined  amphibious  assault.” 

2)  From  the  description  given,  does  the  piece  of  material  seem  to  zero  in 
on  some  aspect  of  what  needs  to  be  taught  in  your  course? 

—  For  instance,  does  your  course  need  to  train  the  skills  with  sheet  metal? 
Then  the  following  description  of  a  film  may  suggest  a  piece  of 
material  that  initially  seems  appropriate. 

“MF  55-8525  Machine  Methods  of  Forming  Sheet  Metal 
iB&W— 20  min— 1955)  (Adopted  Navy  film)  How  to  curve 
sheet  metal  and  shape  curved  parts.” 


3)  If  the  material  relates  to  equipment,  from  the  description  given,  is  the 
equipment  currently  in  use  in  your  MOS? 

—  For  example:  If  you  were  reviewing  a  course  for  finance  clerks 
which  explained  the  use  of  the  manual  adding  machine,  and  your 
learning  objectives  specified  the  use  of  the  electronic  calculator, 
then  that  particular  piece  of  material  would  not  be  suitable. 

4)  From  the  description  given,  does  the  piece  of  material  require  equipment 
that  you  know  will  not  be  available  for  training9 

—  For  example:  You  are  developing  a  course  for  a  lab  technician  and 
the  material  includes  a  specimen  of  a  particular  virus,  which  must  be 
viewed  through  an  electron  microscope.  Such  microscopes  are  unavail¬ 
able,  thus  you  cannot  use  that  specimen. 

5)  ETC. 

Use  of  Catalog: 

—  Since  each  catalog/index  may  differ  in  the  way  it  is  set  up,  there  are  several 
ways  of  looking  up  material  in  which  you  are  interested. 

—  Check  the  front  of  each  catalog  for  guidelines  on  the  use  of  that  particular 
catalog. 


from  block  27 


28  | 

•  Nam*,  number,  etc.,  of  potential  material  it  recorded  to  that  material  may  be 
obtained  lor  further  evaluation 

•  Example  tee  below 


to  block  29 


Record  All  Appropriate 
Entries  (Name,  No  ,  etc.) 


Who-t  doeA  RR  She.el  8  look  Like.  a^toA  name*  ofa 
potential  Itmi  oft  mXoAlal  aAe  Ktc.on.dzd? 

Example: 


Pege _ t  ol  /  Peget 


ISD  III. 3  Review /Select  Existing  Material 


REFERENCE  REVIEW  SHEET  B 

(RR  Sheet  B) 


K-31 


from  block  28 


How  do  1  obtain  tke.  mateAiaZ  n.zc,on.d<id  in  cotimn  2 
oj  RR  SkzU  B? 

•  Materials  may  be  obtained  through  your  supervisor,  MOS  library,  or  school  library. 

•  Some  material  (e.g.,  Army  material)  may  be  easier  to  get  than  others.  Obtain 
all  material  that  is  available  within  a  reasonable  length  of  time  (e.g.,  4-6  weeks). 


K-32 


What  donb  RR  ShzeX  8  look  tike.  a^toA  A&aAon  ^on. 
imavcUIablZily  o  &  maX^JuaJib  Xb  n.2.c.otidnd? 

Example: 


p»»  /  o«  / _ Pages 


1SD  III  3  Review /Select  Existing  Material 

REFERENCE  REVIEW  SHEET  B 


MOS  Cod.  /?// 

Dai 

//;io/7g 

Skill  Level  / 

Vour  Name  ^p 

C  John  ^OPP<t 

Col  1 

R«terencat  (Irom  RR  Sheet  A) 

Col  2 

Materials  leg  name  number  etc  t 

— 

Cot  3 

Examine 
m  Depth’ 

- —A 

-  ■  ^  - 

Col  4  V 

S'  Comments  \ 

- - — - X— 

1  #  X*  Cp^0mjt  1-2 


Qu*  &/  -  pnm 


from  blocks  31  and  32 


Scan  Fiut/Nam 
Available  Manuals 

[Co<  I  i»2.  RRShwiBl 


to  block  34 


•  This  block  bagmi  tha  procets  of  scanning  mattrial  to  d*t*»miiw  if  n  should  be 
bald  and  ax  ami  nad  in  dipth  at  a  latar  time. 

•  Fqi  guidance,  see  bale*. 


How  do  I  4  can  tkt  moutnAAjoUL? 

•  Scanning  Material: 

—  Material  should  be  quickly  looked  over  to  determine  whether  it,  in  fact, 
matches  the  description  given  in  the  catalog.  For  example: 

Suppose  the  catalog  description  said  the  item  of  material  explained  how  to 
tune  an  engine.  You  quickly  scan  the  material  and  see  that  what  the  particular 
item  of  material  really  does  is  describe  how  a  well-tuned  engine  should  perform. 
The  description  of  the  material  and  what  the  material  actually  does  do  not 
match.  Thus,  this  material  is  of  no  further  use  to  you. 

—  Material  should  be  quickly  looked  over  to  see  whether  it  is  out  of  date.  For 
example: 

The  description  of  the  material  says  that  it  teaches  the  care  and  maintenance 
of  a  particular  piece  of  equipment.  However,  the  piece  of  equipment  has 
been  sufficiently  updated  so  that  the  material  is  now  out  of  date.  Here,  too, 
the  material  is  of  no  further  use  to  you. 

•  Scanning  material  should  not  be  a  very  time  consuming  process,  and  yet,  enough 
attention  should  be  given  to  allow  you  to  make  informative  judgments  on  whether 
to  hold  the  material  for  further  evaluation. 
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from  block  33 


to  block  37 


What  dozA  tl le  RR  Si iee£  B  look  ILkz.  a^tZA.  I  toe 
A.zc.on.dz.d  thz.  anAWZA  to  whzXkzA  thz  matzAtal 
should  bz  zxamlnzd  In  dzpth? 

Example: 


P»g>  /  of  /  P»gt 


ISD  III. 3  Review/Select  Existing  Material 


REFERENCE  REVIEW  SHEET  B 

(RR  Shoot  8) 


MOS  Coda  M  H 

Dote 

UJio/lS 

Skill  Lml  / 

Your  Nome  SF£  ToAr  ^Opoa. 

_g__  _ 

Col  2 

Material*  (e.g.  mme,  number,  etc.)  i 

S 6>l.  3 
Exomine 
in  Depth? 

Col.  4 

Comment* 

p n  Pt~  151  3  0 

P>+  C jt 

-  ■ 

_  .  . 

«P§ 

from  blocks  35  and  36 


•  Thu  Slock  bvgms  thi  procan  ol  «n  in  depth  review  ot  teiected  materials 

•  Usefulnen  of  materials  is  judged  according  to  how  consistent  an  item  of 
material  is  with  pre  determined 

-  Learner  characteristics  -  Delivery  system 

•  Learning  guidelines  -  Management  plan 

•  For  further  explanation,  see  below. 


to  block  39 


1 


ifJkcut  do  I  Zook  Ion  u)km  examining  <Lxa>£lng  moutoJujaZ? 

•  When  examining  a  piece  of  existing  material,  whether  it  is  a  complete  course, 
part  of  a  course,  or  perhaps  only  a  visual  aid  from  an  existing  course,  you  want 
to  judge  its  usefulness  for  the  instruction  currently  under  development.  This 
judgment  is  based  on  data  already  collected  during  the  ISD  process.  If  this  data 
is  not  available  to  you,  you  may  have  to  do  a  little  research  on  your  own  and 
rely  on  past  experience  in  order  to  make  a  judgment.  Specifically,  review  the 
material  to  see  if  it  is  consistent  with  the  following  factors: 

1)  Characteristics  of  your  target  population 

2)  General  learning  guidelines 

3)  Delivery  system 

4)  Management  plan 
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Hints  for  an  Efficient  Examination  of  Existing  Materials 

1.  Be  sure  to  look  at  each  piece  of  material  with  reference  to  all  four  judgment 
factors  (i.e..  Trainee  Characteristics,  Learning  Guidelines,  Delivery  Systems,  and 
Management  Plan)  at  the  same  time. 

DO  NOT  review  material  first  with  only  one  factor  in  mind  (e.g.,  trainee 
characteristics)  and  then  go  back  and  re-review  the  material  each  time 
for  the  other  factors.  This  is  a  waste  of  time. 

Remember,  you  want  to  make  the  most  efficient  use  of  your  time  and  energy! 

2.  You  may  want  to  make  a  check-list  forveach  piece  of  material  to  keep  track  of 
what  you  have  seen  regarding  how  consistent  it  is  with  the  four  factors. 


Wkout  axe  4ome  guti.deJU.neA>  £ ox  Sie.v4.2uti.v1g  mcuteAtiat? 


•  In  reviewing  material  use  the  following  guidelines. 


1) 


Is  the  material  consistent  with  characteristics  of  target  population? 


b) 


Administrative  requirements  which  involve  personnel  compliance  with 
regulations  and  states.  The  trainees’  rank,  security  clearance,  time 
remaining  in  service,  etc.  may  exclude  them  from  using  certain  materials. 


Physical  requirements  which  include  specific  skills  and  general  fitness, 
including  age,  sex,  height,  color  perception,  night  vision,  etc.  required 
for  materials  under  review. 


c)  Academic  requirements  which  include  educational  or  aptitude  con¬ 
siderations,  prerequisite  training,  English  language  fluency,  math  skills, 
reading  comprehension,  etc.  required  to  understand  materials  under 
review. 


GUIDELINES  (continued) 

2)  Is  the  material  consistent  with  general  learning  guidelines  which  should  be 
features  of  all  instruction* 

a)  Inform  the  trainee  of  Lhe  objectives. 

The  trainee  must  be  told  specifically  what  performance  will  be  expected 
of  him  at  the  end  of  instruction.  He  must  also  be  told  under  what  con¬ 
ditions  and  to  what  standards  he  is  to  perform. 

b)  Demonstrate  the  desired  behavior. 

The  material  must  help  demonstrate  to  the  trainee  the  expected  perform¬ 
ance.  For  example,  if  your  instruction  under  development  is  related  to 
the  task,  “Use  a  lathe,”  it  is  not  sufficient  to  give  only  a  verbal  description 
of  the  performance.  You  also  want  to  use  visuals  to  demonstrate  “how 
to  do  it.” 

c)  Provide  for  active  practice. 

Especially  when  learning  physical  skills  the  trainee  must  engage  in  active 
practice.  This  practice  must  be  provided  under  realistic  conditions,  using 
the  same  tools/equipment  which  will  later  be  available  on  the  job. 

d)  Give  feedback  to  the  trainee. 

Feedback  is  information  which  the  trainee  receives  after  a  performance. 

It  tells  him  how  correctly  he  performed.  Feedback  can  be  natural, 

(i.e.,  observing  holes  made  in  a  firing  target),  or  artificial  (i.e.,  instructor’s 
comments).  Feedback  is  usually  more  effective  when  given  immediately 
after  performance. 


•NOTE:  May  not  apply  when  you  are  reviewing  an  isolated  piece  of  material,  such  as  a  slide  or 

chart,  etc.  In  this  case  check  to  see  if  the  material  could  be  made  consistent  with  these  guidelines. 
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GUIDELINES  (continued) 

3)  Is  the  material  consistent  with  the  delivery  system  specified  for  instruction 
under  development? 

The  delivery  system  includes  all  the  types  of  facilities  and  equipment  which 
have  been  specified  for  the  type  of  instruction  you  have  been  assigned  to 
develop.  Examples  of  delivery  systems  include: 

a)  texts,  lectures,  demonstrations 

b)  programmed  texts  (branching  or  linear) 

c)  computer-assisted  instruction 

d)  simulator  with  tutor  and  tests,  etc. 

4)  Is  the  material  consistent  with  the  management  plan  for  instruction  under 
development? 

Management  plans  are  designed  to  schedule  the  presentation  of  materials 
and  activities.  If  the  existing  materials  do  not  match  the  management  plan, 
usually  the  management  plan  can  be  revised  to  fit  the  materials. 


from  block  38 


OilrnwWRacord 
Acceptability  oi  Iwm 
of  MiWfttf 
(Col  4,  RR  Sheet  81 


to  block  40 


•  An  item  ol  meieneJ  may  be 

-  Accepted  at  is 

-  Rejected 

-  Revised 

•  For  lurthet  mtoimePon  end  esemple.  tee  below 


Hou)  do  I  de.CA.do,  upon  and  siocosid  acceptability  o& 
the.  existing  matejUaJU'! 

•  There  are  three  possible  categories  into  which  existing  materials  belong.  These 
categories  are: 

1)  Accept  as  is  for  use 

2)  Reject  as  being  impossible  or  impractical  for  use 

3)  Revise  for  use 

•  Explanation  of  categories: 

1)  Accept 

Materials  which  can  be  used  “as  is”  because  they  are  consistent  with 
the  four  evaluation  factors. 

2)  Reject 

Materials  which  are  not/could  not  be  made  consistent  with  the  four 
evaluation  factors.  The  reasons  they  should  not  be  revised  are 
that  they  would  lose  their  instructional  value,  or  that  it  would  be 
less  costly  to  produce  more  appropriate  material. 

3)  Revise 

Most  materials  will  fall  into  this  category.  The  decision  to  revise 
materials  is  reached  by  asking  the  following  questions: 

a)  Can  something  be  deleted  from  the  material  to  make  it  more 
appropriate? 

b)  Can  something  be  added  to  the  material  to  make  it  more 
appropriate? 

c)  Can  something  be  deleted  and  something  else  be  added  to  make  it 
more  appropriate? 


d)  Will  material  be  in  use  for  a  long  time  so  that  cost  of  revisions 
are  justified?  (Sometimes  less  than  perfect  materials  should  be 
retained  as  is  because  revision  costs  are  not  justified). 

e)  Will  the  physical  condition  of  the  materials  withstand  revision? 

For  example,  a  film  may  have  been  cut  and  spliced  so  many  times 
that  it  is  completely  worn  out. 

—  It  is  often  easier  to  change  the  delivery  system  and/or  management  plan  if  they 
do  not  match  materials,  than  to  change  the  materials  themselves. 

•  Record  your  decision  to  accept,  reject  or  revise  the  item  of  materia!  in  Col.  4, 

RR  Sheet  B.  (Front) 

Wh at  doeA  RR  Sheet  B  look  like  afiteA  1  have  tieco  sided 
"accept,"  "sieject"  os i  "sievh>e"? 


Example: 


ISD  III. 3  Review/Select  Existing  Material 

REFERENCE  REVIEW  SHEET  B 


MOS  Cod.  H  H _ 

Skill  Lwxl  / _ 

Col  1 

References  (from  RR  Sheet  A) 


HO/  7! 

SFc  ToA.  Sa 


I  P*  -jSI-36 


Col  2 

Materials  le  g.  name,  number,  etc  ! 

Col  3 
Examine 
in  Depth7 

Col  4 

/  Comments 

&/- 

X- 

1  Pvt  - 

L  X.CCC.pf-  _ 

Hp V.  *V  (/S*r  4r  #S*3*  S3  \ 

y  / 

_  _ 

1 T*c.A»tfv*s  7 F  7 **/2/ 

7h.tr  IF  I 

y  { 
N _ \ 

few  j« 

_ J  *■*■+•  _ 

Ltnd  AMdfi *•**'*"  4k  7 

7  7 

M 

.  i««ff 

\  - __ 

from  block  39 


How  do  I  n&ojoKd  MiggeAtzd  stev^con*  ui  tx/^ting 
mcutzAlal? 

•  Look  at  the  reverse  side  of  RR  Sheet  B.  Here  you  will  find  space  for  recording 
the  name  of  the  piece  of  material  to  be  revised  in  Column  A.  In  Column  B 
there  is  space  to  record  the  type  of  revision  you  .recommend. 


•  Examples  of  suggested  revisions  can  be  seen  here. 


■1 


from  blocks  40  and  41 


What  is  the  Importance  preparing  comments  fior  people 
working  in  other  steps  o£  the  instructional  systems 
development  process?  Hom  do  I  record  them? 

•  In  order  for  the  Instructional  Systems  Development  process  to  work  effectively 
it  is  imperative  that  there  be  forward  and  backward  communication  between  the 
people  involved  in  the  process.  At  some  time  or  other  you  have  probably  com¬ 
plained  about  the  input  that  had  been  provided  to  you.  At  other  times,  you  may 
have  had  to  do  work  that  should  have  been  performed  in  previous  steps. 


IT  IS  IMPORTANT  THAT  YOU  FEED  THIS  INFORMATION  BACK  TO 
THE  APPROPRIATE  PEOPLE  SO  THAT  REVISIONS  CAN  BE  MADE  TO 
EFFECT  IMPROVEMENT  IN  THE  END  PRODUCT. 
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In  your  research  for  this  step  of  the  Instructional  Systems  Development  process  you  may 
have  discovered  additional  information  that  you  think  may  be  useful  to  people  who  will 
be  working  in  steps  that  follow.  If  so,  it  is  equally  important  that  you  pass  this  infor¬ 
mation  on  to  appropriate  people. 


REMEMBER,  COMMUNICATION  WITHIN  THE  INSTRUCTIONAL  SYSTEMS 
DEVELOPMENT  PROCESS  IS  CRITICAL  FOR  EFFECTIVE  INSTRUCTIONAL 
DEVELOPMENT-FOR  SUCCESSFUL  MISSION  ACCOMPLISHMENT. 


•  A  copy  of  the  ISD  COORDINATION  SHEET  can  be  found  at  the  back  of  this 
manual.  Make  sufficient  copies  to  enable  you  to  send  one  to  every  individual 
you  wish  to  communicate  with— plus  copies  for  your  records. 

•  Complete  the  ISD  COORDINATION  SHEET  in  duplicate.  Send  one  copy  to  the 
individual  and  attach  one  copy  to  the  worksheets  you  used  in  this  job  aid. 
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START 


. '  Hwi  n. 

You  Read  the^v 
'^inuoducuati  to  the  Us*- 
ol  Job  Aids 


I  Introduction  10  the  Us* 
I  ol  job  Aids 


Idlntify  Record  Other 
Army  Reference 
Maieiiais 

ISectmn  1.  AA  Sheet  A! 


Obtain  DA  Pam  611  11 
000  Occupational 
Connoivon  Table 


-  You  Aaio<d'\ 
/  the  Hama  ol  a  Pieeeni^- 
■^Army  Count  in  Section^ 
RA  Shots  A 


Obtain  Remnant 
Materrat  from  Cwrsett) 


Used  Tins  Job  Aid 
\  Bttora  / 


/  Do  You 
Know  How  to  Use 
.  DAP*m6l1  11  -■ 


Obtain  All  References  I 
Rtcoidtd  on  RR  Sheet  A  1 


Went  to  n 
Sat  an  Overview  ol 
"V-  the  Job  Aid  / 


Overview  ot  Review/ 
Select  Earning  Mattf.ai 
Job  Aid 


Examine  OA  Pam  611  H 
to  Identity  Any  Sarvice(s) 
Wnft  Occuptnontl 
Specialty  Similar  to 
Army  MOS 


Guidance  1,1  Using 
OA  Pam  611  11 
December,  197?  Vernon 


Record  Reason  tc 

UnavftaWity 


I  Accord  Under  "Com 
manes",  RR  Sheet  At 


Identify  the  Type  o* 
Instruction  You  Have 
Been  Assigned  to 
Gmiufi 


Of  More  Service'-' 
Have  Similar  Occupa 


Record  Occupational 
Specialty  Codas  lor  Other 
Services. 

II  N^ne.  RKord  "None" 
[Section  1,  RR  Sheet  Al 


Reco-d  ON  RR  SHEET  B 

First/Neat  Availatta 
Rifarance 


This  Reference 
a  Catato^'lnje* 


Record  on  Top  ol 
RR  Sheet  A 
MOS  Coda  Name 

Still  Level  Date 

Instruction  Under  Develop 


Identify  and  Record  Name 
ol  Existing  Army  Course!)) 
lor  the  Tasks  You  Wish  in 
Tram 

'Seer-on  >.  RR  Sheer  A) 


Ident-fy'Reeord  Appro 
pnatt  References  From 
Other  Sources 
ISitClion  3,  RR  Sheer  Al 


H*.e  RR  Shaft  A 
I  Reviewed  tor  Completeness 
and  Accuracy 


Identity  and  Record 
Appropriate  References 
tor  Other  Service(s) 

I  Section  ?.  RR  Sheet  Al 


Identity  "Entnes"  in  I 
Cetalog/lndex.  ate  That  1 
Appear  fo  be  Appropriate  | 


Record  All  Appropriate 
Entnes  (Name.  No  .etc  ) 


r 


In  your  research  for  this  step  of  the  Instructional  Systems  Development  process  you  may 
have  discovered  additional  information  that  you  think  may  be  useful  to  people  who  will 
be  working  in  steps  that  follow.  If  so,  it  is  equally  important  tnat  you  pass  this  infor¬ 
mation  or.  to  appropriate  people. 


REMEMBER,  COMMUNICATION  WITHIN  THE  INSTRUCTIONAL  SYSTEMS 
DEVELOPMENT  PROCESS  IS  CRITICAL  FOR  EFFECTIVE  INSTRUCTIONAL 
DEVELOPMENT-FOR  SUCCESSFUL  MISSION  ACCOMPLISHMENT. 


•  A  copy  of  the  ISD  COORDINATION  SHEET  can  be  found  at  the  back  of  this 
manual.  Make  sufficient  copies  to  enable  you  to  send  one  to  every  individual 
you  wish  to  communicate  with— plus  copies  for  your  records. 

•  Complete  the  ISD  COORDINATION  SHEET  in  duplicate.  Send  one  copy  to  the 
individual  and  attach  one  copy  to  the  worksheets  you  used  in  this  job  aid. 
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JOB  AID  FOR 
DEVELOP  INSTRUCTION 

ISD  1 1 1.4 

Manual 


This  is  the  12th  in  a  series  of  ISD  Job  Aids  for  use  in  instructional  design  and 
dwelopment  This  volume  is  to  be  used  as  a  supplement  to  the  primary  document 
Job  Aids:  Descriptive  Authoring  Flowcharts  ISD  III.4  Develop  Instruction  ”  The’ 
flowchart  document  will  direct  you  to  specific  guidance,  examples,  and  references 
provided  in  this  volume.  If  you  do  not  have  the  primary  flowchart  document 
request  it  from  your  supervisor. 


The  wording  in  this  manual  should  not  be  construed  to 
discriminate  between  the  sexes.  In  order  to  avoid  a 
repetitious  use  of  the  terminology,  "he/she,"  the  terms, 
"he,"  "him,"  and  "his,"  as  well  as  "men,"  are  intended 
to  include  both  the  masculine  and  feminine  gender.  Any 
exceptions  to  this  usage  will  be  so  noted. 
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ISD  1 1 1.4  Develop  Instruction 


to  block  3 


What  t 4  the.  job  aid  ion.  Ve.ve£optng  Jn6  tnuctton  alt  about? 

•  GOAL 

—  At  this  point  all  available  off-the-shelf  materials  have  been  selected  and  included 
in  the  instruction  under  development.  Now  you  are  ready  to  complete  what¬ 
ever  instructional  materials  are  still  needed  to  produce  the  desired  result  with 
the  trainees— the  attainment  of  the  terminal  learning  objectives  (TLOs). 

—  The  main  goal  of  this  job  aid  is  to  assist  you  in  producing  training  materials 
in  the  following  media: 

•  audio-only 

•  audio-visual 

•  written  text 

—  A  secondary  goal  is  to  familiarize  you  with  the  ways  in  which  the  various 
production  personnel  can  help  you  in  your  efforts. 

—  This  job  aid  does  not  cover: 

1)  Every  type  of  delivery  system 

2)  Guidance  for  the  preparation  of  user  instructions 

For  this  information  see  TRADOC  Pam  350-30,  Block  III .4,  Develop  Instruction. 


•  OBJECTIVES 

1)  Given  a  list  of  learning  objectives  with  their  learning  guidelines  and  activities, 
delivery  system  and  management  plan,  and  selected  existing  instructional 
materials,  conduct  the  following  activities: 

1)  determine  resource  requirements 

2)  sort  objectives  according  to  media 

3)  develop  first  draft  of  materials 

4)  use  formula  to  determine  reading  grade  level  (written  text  only) 

5)  revise  reading  level  if  necessary 

2)  Given  an  Instructional  Development  checklist  indicate: 

1)  the  type  of  instruction  being  developed 

2)  successful  accomplishment  of  development  procedures  for  the  particular 
type  of  instruction. 


•  PRODUCTS 

—  Use  of  this  job  aid  will  result  in  the  production  of  first  draft  instructional 
materials  in  one  of  the  following  media: 

•  audio-only 

•  audio-visual 

•  written  text 

and  a  completed  checklist  for  the  appropriate  media. 


•  MAJOR  STEPS  IN  PROCESS 

1)  Determine  resource  requirements 

2)  Sort  objectives 

3)  Select  media  and  develop  first  draft  materials 

•  audio-only 

•  audio-visual 

•  written  text 

4)  Cheek/revise  reading  level  of  written  materials 
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WORKSHEET  USED 


—  On  page  L-8  you  will  find  an  example  of  a  completed  Instruction  Development 
Checklist. 


DESCRIPTIVE  FLOWCHART 

—  The  flowchart  on  pages  L-62  thru  L-63  shows  the  major  steps  in  the  use  of 
the  Job  Aid  for  Developing  Instruction.  The  flowchart  will  be  useful  to  you 
in  getting  a  clear  picture  of  the  overall  process  used  in  this  job  aid.  A  more 
completely  described  flowchart  is  provided  in  Job  Aids:  Descriptive  Authoring 
Flowcharts,  pages  L-3  thru  L-J3. 


from  blocks  4  and  5 


No 


to  block  8 


•  In  aider  to  develop  instruction  it  n  necessary  to  have 
the  fallowing  mf  i« 

-  (tom  ISO  Phas*  it 

•  3  putt  learning  objectives 

•  corresponding  test  items 

•  group  letter  and  sequence  number  for  each  objective 

-  from  ISO  Phta*  ill 

•  learning  category  and  subcategory  for  each  objective 

•  corresponding  learning  activities 

•  management  plan  and  delivery  system 

•  selected  existing  instructional  materials 


•  The  Outputs  of  the  4  blocks  at  ISO  Phase  II  and 
III  1.  Ili  2.  and  111.3  should  be  available  (iom 
persons  responsible  lor  those  activities 

•  II  procedures  (or  any  of  these  activities  were  not 
complete  Job  Aids.  Descriptive  Authoring  Flow 
charts  may  be  referred  to  as  lollows 

-  Oevel op  Objectives,  pages  E  3  thru  E  13 

-  Develop  lasts,  pages  F  3  thru  F  00. 

-  Sequence  and  Structure  Objectives,  pages  M3 
tutu  H  00 

-  Learning  Categories/Activities,  pages  t  3  thru  I  oo 

-  Management  flan  .'Delivery  System,  pages  J  3 
thru  J  12 

Select  Easting  Materials,  paged  K  3  thru  K  -11 


Guidance  for  Obtaining/ 
Preparing  Outputs  of 
ISO  Phase  ll  and  MM. 
III.?,  and  III  3 


from  blocks  6  and  7 


8#*n  Process  ot 
Detifmimng 
HKource  Requirements 


•  Thu  block  begins  the  process  of  identifying 

-  instruction*!  needs 

-  resources 

-  construct* 

•  Process  n  KComplished  m  blocks  9  thru  13 


to  block  9 


from  block  8 


Dttumme  Inttfucuonil 

Hm6t 


to  block  10 


•  Inrottciiontl  ntvfe  we  dtter mined  on  iht  beat  of  previow  enatyiM  and 
pfewtmj  erfnck  (00*  place  m  (SO  Phan  (( am)  Ilf. 

•  For  further  information,  an  below 


What  (Viz.  the.  inAtAii<vtlonal  nz.z.di>  and  how  do  I  Idz-yitifiy  them? 

•  The  inputs  of  ISD,  Phase  II  and  Phase  III,  up  to  this  point  will  tell  you  what  is 

required  from  your  instruction— what  needs  to  be  trained  and  how  to  train  it. 

For  example: 

—  Learning  Objectives  (LOs)  tell  you  specifically  what  content  must  be  covered. 

—  LO  group  letters  and  sequence  numbers  tell  you  how  many  modules,  chapters, 
blocks,  etc.  of  instruction  it  will  take  to  cover  this  content.  (Although  the  LOs 
should  be  considered  “final”  at  this  point,  it  is  quite  possible  that  you  may 
want  to  revise  the  grouping  and  sequencing  decisions  when  you  actually  get 
into  producing  the  instruction). 

—  Test  items  will  let  you  know  how  the  objectives  are  to  be  tested,  both  before, 
during,  and  after  instruction. 

—  Learning  categories  and  the  corresponding  learning  activities  will  give  you  a 
great  deal  of  specific  information  as  to  the  form  and  format  of  your  instruction. 

—  The  management  plan  and  delivery  system  will  let  you  know  exactly  what  media 
to  use  and  how  to  manage  the  overall  course  of  instruction. 

—  The  selected  existing  materials  show  you  which  parts  of  the  instruction  you  do 
not  need  to  develop  because  adequate  material  is  already  available  for  those 
parts. 
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from  block  9 


Study  Type*  of 
Resource  end  Cost 
Factory  for  Developing 
Instruction 


to  block  1 1 


•  For  Types  of  instructional  resource  and  cost  factors,  see  bemw 


What  cvid  tkn  fi&6ouAceJ>  and  coAt  {acjtnnt  u)htch  mint 
be  CLomtdeA&d  u)he,n  de.ve£optng  tnstsiuctton? 

•  The  tables  below  list  the  types  of  resources  and  cost  factors  which  must  be 
considered. 


Resources  to  Be  Considered 


Cost  Factors  to  Be  Considered 


RESOURCES 

COST  FACTORS 

Equipment 

Development 

•  Instructional 

Investment 

•  Support 

•  Equipment 

Facilities 

•  Facilities 

•  Classrooms 

Operation  and  Maintenance 

•  Laboratories 

•  Equipment 

•  Special-purpose 

•  Facilities 

Manpower 

•  Pay  and  allowances 

•  Instructors 

•  Instructional  administrators  and 

supervisors 

•  Base  administration  and  support 

L-U 


DEFINITIONS  OF  RESOURCES  AND  COST  FACTORS 


—  Equipment 

a.  Instructional  equipment  includes  any  item  or  combination  of  items  used  for 
instruction.  Some  examples  include  media  hardware— projectors,  screens, 
cameras,  simulators,  trainers,  aids,  etc. 

b.  Support  equipment  includes  any  item  or  combination  of  items  needed  for— 
but  not  actually  part  of— instruction.  Some  examples  of  support  equipment 
are  chairs,  desks,  typewriters,  filing  cabinets,  and  mobile  power  units. 

—  Facilities 

An  instructional  facility  is  the  physical  complex  in  which  instruction  is  con¬ 
ducted,  or  the  physical  area  which  provides  for  the  direct  support  for  instruction. 
Some  examples  include  classrooms,  laboratories,  carrels,  or  special-purpose  areas 
such  as  aircraft  parking  and  run-up  ramps,  pole-climbing  areas,  or  site-development 
areas. 

—  Manpower 

Manpower  includes  all  personnel  required  to  accomplish  the  missions  and  work¬ 
loads.  Manpower  requirements  for  an  instructional  system  include  instructors, 
administrative  personnel,  curriculum  specialists,  writers,  instructor  supervisors, 
media  specialists,  graphic  artists,  print  specialists,  TV  producers,  photographers, 
audio  producers  and  technicians. 

—  Costs 

Certain  costs  are  associated  with  each  resource.  In  determining  financial 
requirements  for  equipment,  facilities,  and  manpower,  consider  three  types 
of  costs: 

(1)  Cost  of  Acquiring  and/or  Developing  the  Resources.  This  includes 
acquisition  costs  for  instructional  equipment,  support  equipment, 
facilities,  and  the  design  and  development  of  course  materials  and 


and  any  special  equipment.  Development  costs  will  include  pay  and 
allowances. 

(2)  The  Investment  They  Represent.  This  includes  the  per-student  cost, 
and  the  potential  for  future  use  or  reuse. 

(3)  The  lost  of  Operation  and  Maintenance.  This  includes  cost  after 
acquisition  which  may  be  needed  to  keep  equipment  and  facilities  up 
to  standard. 


from  block  10 


to  block  1 2 


•  Foi  guidance  in  identifying  availabla  rnourcts,  we  below 


How  do  7  Idzntiiy  avaUZable.  fieAouAaeA? 

•  At  this  point  a  final  check  should  be  made  to  insure  that  the  required  resources 
are  definitely  available.  It  certainly  would  be  ill-advised  to  plan  for  a  certain 
format  of  instruction  and  then  find  out  that  resources  once  thought  to  be  avail¬ 
able  will  not  be  available. 

•  You  can  identify  available  resources  by  doing  the  following: 

1)  Obtain  copies  of  the  production  facilities  documentation  regarding  develop¬ 
ment  of  classroom  instruction,  video  instruction,  audio  instruction,  slide- 
tape  presentations,  demonstrations,  computer  applications,  and  any  other 
additional  materials  of  this  type.  Local  regulations  or  servicewide  regula¬ 
tions  may  exist  relative  to  the  acceptable  format  for  presenting  materials 
for  processing.  Where  these  are  available,  be  sure  to  obtain  copies.  Most 
of  these  publications  have  not  been  developed  within  an  Instructional  Sys¬ 
tems  Development  Model  context.  While  they  may  have  to  be  adapted  to 
your  needs,  they  still  should  prove  extremely  helpful. 

2)  Find  out  how  .o  get  the  subject  content  into  a  form  that  the  production 
facility  can  ea.ily  use.  For  printed  materials  this  may  include  length  of 
typed  lines  permissible,  page  numbering  locations,  etc.  For  audio  material, 
a  script  must  be  prepared  in  a  format  acceptable  to  narrators.  Visual 
materials  require  an  idea  of  what  the  final  form  will  be— still  slide,  film- 
loop,  video  tapes,  etc. 

3)  Find  out  how  much  assistance  can  be  expected  from  the  production  facility. 
Get  as  much  information  as  possible  on  how  they  would  suggest  developing 
the  particular  instruction.  Production  facility  personnel  require  that  ideas 
be  presented  in  a  form  they  can  understand  because  that  is  what  is  used  as 
the  basis  for  judging  their  costs  and  their  requirement  for  experienced  per¬ 
sonnel.  From  the  description  of  planned  new  instruction,  it  will  also  be  possi¬ 
ble  for  them  to  give  an  elapsed  time  estimate.  From  this  estimate,  you  may 
decide  to  accept  some  suggested  alternatives  that  may  be  almost  as  good,  or 
perhaps  better,  than  what  was  originally  planned.  Though  general  alternatives 
should  have  been  selected  in  Block  III. 2,  there  are  production  alternatives 

as  well. 


*  .'i*  i 
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from  block  1 1 


•  F  oi  description  ot  (unctions  o(  the 

-  media  specialist 
graphic  artist 
print  specialist 
photographer 

audio  producer  (engineer) 

-  technician 

•  For  further  guidance, tee  beioM 


(jJkaX  ajiz  the  function*  o£  production  personnel? 

/ 

•  The  following  list  provides  a  general  description  of  the  functions  of  production 
personnel  who  can  provide  assistance  in  the  actual  development  of  instructional 
materials. 

1.  Media  Specialist  (Consultant).  Media  specialists  often  oversee  and  direct 
media  center  personnel.  The  media  specialist  is  usually  knowledgeable  in 
all  areas  of  media  selection,  identification  of  unique  media  and  stimulus 
characteristics,  feasibility  of  different  media  for  various  instructional 
purposes,  media  production  costs,  use  of  hardware  and  accompanying  soft¬ 
ware,  and  location  of  media  software  (re:  films,  television  programs,  etc.) 
on  a  wide  variety  of  subjects.  The  media  specialist  may  be  particularly 
useful  in  helping  to  find  existing  materials  in  the  content  areas.  The  media 
specialist  also  should  be  able  to  provide  valuable  suggestions  before  the 
development  of  first  draft  materials  has  begun  to  save  both  time  and  money. 

2.  Graphic  Artist.  Since  a  large  portion  of  media  productions  usually  involves 
some  artwork  in  the  form  of  graphs,  charts,  diagrams,  or  pictures,  the  artist 
is  another  media  professional  whose  assistance  will  be  valuable.  The  graphic 
artist  can  usually  be  called  upon  to  do  a  variety  of  illustrations  of  different 
sizes  from  small  pamphlets  to  large  poster  size  artwork.  Most  artists  also 
can  produce  various  sizes  and  styles  of  printed  lettering.  The  graphic  artist 
also  probably  can  advise  or  give  suggestions  on  the  most  effective  way  to 
visualize  the  instructional  message.  Usually  an  artist  is  capable  of  producing 
sketches  in  rough  form  which  will  be  quite  suitable  for  the  production  cf 
first  draft  materials. 

3.  Print  Specialist.  The  print  specialist  is  skilled  in  the  development,  arrange¬ 
ment,  and  production  of  a  wide  variety  of  print  materials  ranging  from 
pamphlets  and  brochures  to  books.  The  print  specialist  can  assist  in  deciding 
how  to  reproduce  large  amounts  of  material  as  economically  as  possible 
without  undue  sacrifice  of  quality.  He  will  advise  on  the  feasibility,  cost, 
and  preparation  of  various  types  of  artwork  in  either  color  or  black  and  white. 
In  general  this  person  should  be  consulted  on  any  matter  involving  the  pro¬ 
duction  and  duplication  of  printed  materials. 


L-15 


4.  Photographer.  The  photographer  is  capable  of  handling  a  wide  variety  of 
picture  taking  assignments  and  is  versatile  in  developing  and  printing  pictures. 
Much  creative  photography  is  done  in  the  darkroom  rather  than  with  the 
camera;  therefore,  if  any  special  photographic  effects  are  needed,  discuss 

it  with  the  photographer.  It  would  be  helpful  to  show  the  photographer  an 
actual  example  (from  a  past  production  or  magazine  pictures,  etc.)  of  what 
is  needed. 

5.  Audio  Producer  (Engineer).  The  audio  producer  is  responsible  for  producing 
audio  tapes,  audio  cassettes  and  studio  recordings.  The  producer  knows 
what  type  of  microphones  are  suitable  for  different  applications.  The  audio 
producer  can  assist  in  all  production  phases  but  will  be  most  helpful  in 
preparing  the  final  integration  of  the  production  where  the  narration,  music, 
and  other  audio  sounds  are  combined.  The  audio  producer  will  make  certain 
the  audio  production  is  crisp  and  clear  with  no  unnecessary  background 
noises  or  static  and  that  music  and  voices  are  well  modulated. 

6.  Technician.  The  (electronic)  technician  is  a  specialist  in  the  repair  and 
maintenance  of  electronic  equipment  such  as  audio  consoles,  video  switchers, 
cameras,  and  tape  recorders.  The  technician  repairs  equipment  and  is 
familiar  with  the  reliability  of  different  makes  of  audiovisual  hardware. 

Before  purchasing  equipment,  seek  the  technician’s  advice.  It  could  save 
needless  expense  later  on.  The  technician  also  can  familiarize  the  instruc¬ 
tional  designer  with  the  operation  of  production  facility  equipment.  The 
technician  also  may  be  versed  in  the  development  of  new  equipment  and  in 
the  reliability  and  technical  problems  with  different  makes  of  new  “state- 
of-the-art”  equipment. 
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from  blocks  1  2  and  1 3 
14 


Qividt  Tirmin»l  Lwining 
Objtctiws  (TlO's)  Into 
T*  Groups,  A  and  fi 


to  block  15 


*  TlO's  art  initially  sorted  into  two  groups 

A)  those  lor  which  instructional  materials  are  available 

B)  those  lor  which  instructional  materials  mutt  now  be  developed 

•  For  further  i  formation,  see  below. 


(jJkat  aj>  tke,  puApote,  o  ^  tntttatty  Aonttng  TojuninaJL 
Le.<vwtng  ObjucttveA  ( TLO ]  tnto  too  gnoupA? 

•  Before  beginning  to  develop  instruction  you  must  know  exactly  with  which 
learning  objectives  (LOs)  you  will  be  working.  It  is  possible  that  some  off-the- 
shelf  materials  were  located  in  ISD  III.3,  Select  Existing  Materials,  which  are 
perfectly  adequate,  as  is,  for  training  some  of  the  Terminal  Learning  Objectives 
(TLOs).  If  so,  separate  those  TLOs  from  the  ones  for  which  you  must  still 
develop  instruction,  or  for  which  only  a  few  useful  parts  of  existing  materials 
were  available,  such  as  a  series  of  slides,  graphs,  etc.  The  TLOs  for  which  you 
have  available  adequate  instruction  may  be  set  aside  until  the  total  training  pro¬ 
gram  is  put  together. 

•  Thus,  you  now  have  two  groups  of  objectives: 

Group  A— Those  for  which  adequate  instructional  materials  are  already  available. 
Group  B— Those  for  which  no,  or  only  partial,  instructional  materials  are  available. 

•  It  may  be  necessary  to  separate  some  learning  objectives  from  their  terminal 
learning  objective  in  the  event  that  existing  materials  are  available  for  some  of 
the  LOs  and  not  for  others. 
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from  block  14 
•s  I 


to  block  i6 


•  TLO'l  tor  w^'Ch  new  instruction  must  be  developed  ere  now  sorted  according  to 
the  media  which  were  selected  in  ISO  Block  111.2  to  tram  them 

•  For  further  information,  see  below 


Wkcut  the.  puApo-ie  ofi  Aosvting  obje.cXA.vn6  according  to 
type,  ol  me-dia? 

•  In  the  last  step  you  divided  the  LOs  into  Groups  A  and  B.  In  this  step  you  are 
only  working  with  the  Group  B  objectives,  those  for  which  you  are  going  to  pre¬ 
pare  instructional  materials.  These  LOs  will  be  worked  on  one  group  at  a  time, 
according  to  their  media  categories. 

•  SUBDIVIDE  GROUP  B  OBJECTIVES 

—  In  order  to  develop  new  instruction  for  these  LOs,  you  need  to  subdivide 
them  into  media  categories  which  are  compatible  with  the  delivery  systems 
selected  in  ISD  III. 2,  Specify  Instructional  Management  Plan  and  Delivery 
System.  Many  different  delivery  systems  may  have  been  selected  for  the 
Group  B  objectives.  Use  the  following  procedure  for  subdividing  objectives: 

1)  Select  an  objective  (LO) 

2)  Fit  the  delivery  system  suggested  for  this  objective  into  one  of  the  broader 
categories  of  media  listed  below: 

•  AUDIO-ONLY 

Audio-only  scripts  are  prepared  as  part  of  instructional  programs  where  soldiers 
may  be  listening  to  directions  or  explanations  on  an  audio  tape  while  they  are 
performing  or  being  guided  through  a  task. 

•  AUDIO-VISUAL  (specifically  slide-tapes) 

The  slide-tape  is  a  combination  of  slides  accompanied  by  a  tape  recorded  narra¬ 
tion  explaining  and  describing  the  slides.  A  synchronizing  pulse  is  placed  on 
the  audio  tape  to  synchronize  the  audio  and  the  visual.  The  pulse  is  recorded 
on  the  tape  by  the  audio  producer  or  technician.  It  can  be  either  audible  for 
manually  advancing  the  slides  or  inaudible  and  automatic. 

The  slide-tape  is  one  of  the  most  widely  used  of  all  audio-visual  productions  because 
it  is  relatively  inexpensive  to  make,  elaborate  equipment  is  not  required,  and  it  is 
not  difficult  to  reproduce.  Many  Training  Extension  Course  (TEC)  lessons  are 
developed  for  use  with  the  Bessler  Cue/See  projector. 


•  WRITTEN  TEXT 


Written  text  includes  any  type  of  written  lesson  materials  such  as  textbooks, 
pamphlets,  manua  s,  circulars,  lesson  modules,  etc.  (Programmed  Instruction 
requires  a  very  special  type  of  writing  skills  and  is  not  included  in  this  job  aid. 
However,  many  of  the  principles  for  developing  good  written  text  can  be  applied 
to  the  writing  of  Programmed  Instruction. 

•  OTHER 

If  the  delivery  system  is  similar  to  one  of  the  above  you  may  group  the  objectives 
with  the  similar  system.  Otherwise,  place  them  under  “Other.”  This  job  aid  will 
be  useful  only  as  a  guide  to  the  general  principles  of  instructional  development. 

It  can  not  be  used  as  a  procedural  guide. 
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from  block  15 


from  block  16 


to  block  18 


from  block  17 


Obtain  Instruction 
Oavetopmtnt  (ID) 
Checklist 


to  block  19 


•  Imtniciion  Onttopmeni  Checklist  n  uuH  to  document  Steps  m 
preparation  ol  first  draft  manuals 

•  For  guidance  in  obtaining  ID  checklist,  see  below 


Where  can  I  get  cm  Instruction  development  Checklist? 

•  The  Instruction  Development  Checklist  is  available  for  duplication  in  the  pocket 
at  the  end  of  this  manual. 

•  To  see  an  example  of  a  completed  ID  Checklist,  refer  to  page  L-8  . 


from  block  18 


Record  Identifying 
fllfOMMtIOfl 
(10  Cheeklatl 


to  block  20 


•  Identifying  information  include* 

-  Your  neme/Offic#  lymbol 

-  Oeie 

-  Couitt/Moduie  under  development 

-  MQS/SkiK  Level 


from  block  19 


ifJkat  aj>  tkt  punpo&n  oh  uA-lng  ApzcMil  t&c.kyiiqu&t>  to 
stimulate,  tke.  audio  -t>e.n6&? 

•  Remember  the  limitations  of  the  medium 

Since  there  is  no  video,  you  want  to  use  techniques  that  will  stimulate  the 
audio  senses: 

—  music 

—  sound  effects 

—  dramatizations 

—  different  voices 

—  changes  in  pitch,  tone,  and  intensity  of  voice 

—  pacing 

However,  do  not  overuse  a  technique.  After  preparing  a  script  take  it  to  the 
audio  producer  for  his  advice  on  how  to  make  it  most  effective. 

•  For  example  of  what  the  ID  Checklist  looks  like  when  techniques  used  to 
stimulate  the  audio  senses  are  selected  and  checked,  see  page  L-8.  Note 
Section  1,  number  1. 


1.24 


Hou)  do  I  pKzpaAt  a.  Item  audio  6CAA.pt  tn 
cosiAect  komat? 

•  Examine  each  learning  objective  and  write  just  enough  of  an  explanation  to  clarify 
each  item.  Do  not  write  more  than  is  needed,  as  you  can  always  add  more  after 
the  first  draft  materials  have  been  tested.  It  is  not  efficient  to  write  any  more 
than  necessary  for  two  reasons: 

1)  Loss  of  time  to  the  course  writer  and  the  student. 

2)  When  lesson  materials  are  tested  it  is  easier  to  identify  problems  due  to  lack 
of  sufficient  information  than  to  identify  excess  information. 

•  When  writing  the  final  version  of  a  script,  use  the  format  shown  below.  Note  that 
the  right  side  of  the  script  contains  all  of  the  spoken  narration  that  will  be  heard. 
The  left  side  is  for  specific  directions  such  as  adding  music  or  sound  effects. 


Format  for  Audio  Script 


Directions 

Narration 

Include  any  special  directions  on 

Write  the  audio  that  will  be  read  by  the  narrator  on  this 

the  left  side  of  the  script.  These 
could  be  music,  sound  effects,  or 

side  of  the  script. 

any  other  outside  sources  which 
will  be  added  to  the  final  script. 

Also,  write  any  special  directions  for  the  narrator  on 
this  side  of  the  script.  For  example,  include  changes  in 
pace,  tone  or  intensity  of  voice  and  indicate  them  in 
brackets  [  ] . 

THE  PART  OF  THE  SCRIPT  TO  BE  READ  IS 

WRITTEN  IN  CAPITAL  LETTERS. 

[Directions  to  the  narrator  are  written  in  lower  case 
letters! 

•  For  example  of  what  the  ID  Checklist  looks  like  when  you  have  prepared  a  lean 
script  in  the  correct  format,  refer  to  page  L-8.  Note  Section  1,  number  2. 


from  block  22 


1 

*1 


ReviewiCheck 
Sc"P<  for  Continuity 
1 1 0  Checklist  I 


•  Foi  further  .nluimation.see  below 


to  block  24 


> 


How  do  I  check  the.  audio  bcntpt  Ion.  continuity? 

•  If  possible,  have  someone  read  the  script  to  you,  or  at  least  read  it  aloud  to 
yourself.  Do  the  ideas  flow,  or  does  the  script  seem  disjointed?  If  any  part 
seems  unclear  or  too  sparse,  add  or  delete  information  where  necessary. 

•  For  example  of  what  the  ID  Checklist  looks  like  when  you  have  checked  the 
script  for  continuity,  see  page  L-8.  Note  Section  1,  number  2. 


« 
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from  block  23 

24 


Pacing  ot  P'titflution 
and  Indicate  on  Script 
HO  Checklist! 


•  for  l-.r|her  •ntormatioo. »e  below 


Hou)  do  I  determine,  the  pacing  music  and  pauses  o & 
tint  presentation  and  indicate  this  on  the  script? 

•  Decide  where  changes  in  the  pace  of  the  presentation  can  best  be  used  to  highlight 
the  script  and  maintain  listener  interest.  For  example: 

—  If  you  want  to  tell  the  audience  what  an  air  raid  siren  sounds  like,  do  not 
describe  its  frequency  and  nitch.  Instead,  use  a  blast  of  a  siren. 

—  Rather  than  simply  explaining  the  contents  of  a  speech,  use  a  dramatization. 

—  Use  appropriate  music  to  bridge  the  gap  between  different  parts  of  the  program. 
(When  using  music,  remember  that  the  music  should  not  attract  undue  atten¬ 
tion  but  should  complement  the  narration.) 

—  If  pauses  in  certain  parts  of  the  script  are  necessary,  indicate  these  on  the  script. 
Also  indicate  if  normal  pacing  changes— either  faster  or  slower. 

•  Indicate  directions  for  pacing  in  lower  case  letters  and  brackets  [  ]  on  right 
hand  side  of  script. 

•  For  example  of  what  ‘he  ID  Checklist  looks  like  when  you  have  indicated  the 
pacing,  music  and  pauses  within  the  script,  see  page  L-8.  Note  Section  1, 
number  4. 
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from  bfock  20 


•  For  lurihn  information,  see  below 


Holv  do  I  plan  the.  uAe.  o&  narration  {o> t  a  Allde.  tape, 
audio -visual  production? 

•  This  job  aid  covers  the  production  of  slide-tape  programs  such  as  are  used  with 
the  Bessler  Cue/See  projector.  With  this  medium  you  want  to  be  sure  that  the 
visual  and  audio  work  together  to  present  the  lesson.  Keep  in  mind  the  follow¬ 
ing  points  when  planning  your  narration. 

—  Narration  (audio)  should  be  used  to  explain  details,  suggest  relationships,  or 
supply  any  kind  of  information  that  cannot  be  adequately  explained  in  the 
visuals. 

—  The  narration  should  always  be  related  to  the  visual  being  seen.  The  narra¬ 
tion  should  not  compete  with  the  visual  by  describing  or  calling  attention  to 
details  not  in  the  visual.  If  in  doubt,  ask  yourself  “does  the  narration  com¬ 
plement  the  visual?’’  If  the  answer  is  no  then  rewrite  the  narration  until 
it  does. 

—  Use  the  narration  to  identify  or  describe  the  content  of  a  visual  as  soon  as 
the  visual  appears.  Do  not  make  the  audience  guess  what  the  content  of  a 
visual  is  all  about.  Tell  them. 

—  Narration  should  always  be  simple.  Do  not  use  long,  complicated  sentence 
structures  with  multiple  clauses.  Use  a  simple  vocabulary.  Try  and  strike 
a  balance  between  brevity  and  simplicity  without  talking  down  to  the 
audience. 

—  Vary  the  pace  of  the  narration:  Allow  for  breaks  of  silence  to  bridge  different 
visuals  or  use  short  musical  bridges  that  serve  to  vary  the  pace  of  the  program. 
Bvit  remember,  the  music  should  complement  the  overall  pace  of  the  program. 
Do  not  use  loud  or  boisterous  music  that  will  distract  from  the  visual  portion 
of  the  program. 


from  block  26 


Hour  do  1  ptan  the  uAe  o{  vtAuati  {ok.  a.  6 tide- tape  pswgKam? 

•  No  single  visual  (i.e.,  slide)  should  be  on  the  screen  too  long.  After  approximately 
20  seconds  the  audience  tends  to  become  bored  and  restless  and  easily  distracted 
from  the  program.  Remember  this  when  planning  the  slide-tape  production  and 
avoid  writing  40  seconds  of  narration  for  a  visual  that  should  not  be  on  the  screen 
longer  than  20  seconds.  If  a  longer  time  period  is  needed  to  explain  a  visual,  a 
second  similar  visual  can  be  planned  to  follow  the  first  one.  The  second  visual 
can  be  taken  from  another  angle  or  be  a  different  size  than  the  first  one.  In  any 
case,  it  should  be  different  in  some  way  but  still  be  logically  related  to  the  first 
one.  Also,  try  to  vary  the  pacing  of  the  program  by  having  slides  on  the  screen 
for  different  periods  of  time.  When  designing  a  program,  do  not  think  of  tech¬ 
nique  first  but  do  remain  aware  of  the  fact  that  the  program  should  be  lively 
and  interesting. 
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from  block  27 


1 


Begin  Production  of 
Slide  Tape 


•  This  block  begins  the  actual  production  of 
the  >d>u  visual  lesson 


to  block  29 


from  block  27 


Pi*parr  Check 
StO'yboaiite 
HO  Cherklittl 


to  block  30 


•  Rough  (ketches  or  (M»  hguiw  die  ceiled 
duly  Doer 

•  f'i'  tu'lher  iiit>jrmitio»  end  guidance 
see  Cipiote 


How  cb  I  p-'iepoA.e  Atosiy  boasidA? 

•  Now  that  you  have  done  some  planning  for  the  audio  and  visual  aspects  of  your 
lesson  you  are  ready  to  start  the  actual  production  of  the  slide-tape.  Follow  the 
sequence  suggested  below: 

1)  Examine  each  learning  objective  to  determine  what  visual  will  explain 
it  best.  Then  draw  a  rough  sketch  to  communicate  with  the  artist 

or  photographer  your  idea.  Rough  sketches  or  stick  figures  are  called 
story  boards.  (An  alternative  is  to  write  a  detailed  description  of  what 
content  the  visual  should  contain. 

2)  Mount  a  sequence  of  sketches  on  a  board  so  that  the  outline  of  the 
sequence  of  your  lesson  can  be  illustrated  (layout). 

3)  In  addition  to  the  sketch,  which  is  placed  at  the  top  of  the  story  board, 
write  on  the  bottom  of  the  story  board  the  narration  which  will  accom¬ 
pany  the  slide.  If  music  is  to  accompany  the  slide  indicate  this  also. 

See  page  L-32  for  example  of  completed  story  board  frame. 

4)  Record  the  number  of  the  Learning  Objective  that  the  story  board 
relates  to. 

•  For  example  of  what  the  ID  Checklist  looks  like  when  these  steps  in  the  production 
story  boards  have  been  completed.  See  page  L-8. 
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4 


Example  of  completed  story  board  frame. 


from  block  29 


Review/ Check  Sequence 
oi  Stocyboirth 
UO  ChtcUvsl) 


to  block  31 


•  For  fuithei  information  and  guidance, 
see  below 


Hovo  do  I  /LevXew?  tke  6e.qu.mcz.  ofi  the.  t>bonjj  botvuh? 

•  The  combination  of  all  the  story  boards  forms  the  script  for  the  slide-tape  pro¬ 
gram.  Therefore  you  want  to  review  the  sequence  of  the  story  boards. 

—  Visualize  the  sketches  on  each  story  board.  Ask  yourself: 

1)  Does  each  picture  and  accompanying  narration  follow  a  logical  sequence? 

2)  Are  there  any  ambiguities,  or  gaps  where  information  is  missing? 

If  so,  add  more  pictures  or  narration. 

—  Run  through  the  sequence  several  times  to  check  the  order. 

•  For  example  of  what  the  ID  Checklist  looks  like  when  you  have  reviewed  the 
sequence  of  your  completed  story  boards,  see  page  L-8.  Note  Section  2, 
number  2. 


from  block  30 


ftan/Indicate/Chack 
Composition  ot  Visuals 
(10  Checklist] 


to  block  32 


•  fat  I  m  the'  information  and  guntawe. 
see  below 


How  do  I  plan  and  Indicate,  the.  composition  ofi 
the  visuals? 

•  As  you  complete  the  activities  below,  check  them  off  the  ID  Checklist  (Section  2, 
number  3) 

•  Be  sure  to  provide  the  photographer  or  graphic  artist  with  enough  information  as 
to  the  composition  of  the  visual.  He  needs  to  know  your  plans  for  such  things  as: 

—  What  details  are  included 

—  Size  of  the  details  (should  certain  parts  of  a  picture  be  photographed  in  close 
detail  or  magnified  (blow-ups))? 

—  Use  of  colors,  highlights 

—  Use  of  arrows,  circles,  numbers  or  other  techniques  to  clearly  delineate 
one  part  from  another  (special  cues) 

—  Use  and  size  of  lettering  on  photos,  diagrams,  etc. 

•  Indicate  this  information  on  the  picture  part  of  the  story  board. 

•  For  example  of  what  the  ID  Checklist  looks  like  when  you  have  planned  the 
composition  of  the  visuals,  see  page  L-8.  Note  Section  2,  number  3. 
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from  block  31 


Compel*/ Chick  Visual 
Compontnts  by 
Consultation  with 
ftiOlogtiphUfAilisf 


to  block  33 


•  f  0'  further  information  and  guidance, 
see  below 


Whcut  -C6  the.  punpo&e,  oi  consulting  mXh  the. 
photo gnapheA  on  gnapkic  ajutist? 

•  Whether  your  story  boards  call  for  the  use  of  photos  or  drawings,  each  frame 
should  now  indicate  the  exact  composition  of  the  desired  visual. 

•  For  Photographs 

—  If  your  story  boards  call  for  photographs,  take  them  to  the  photographer  so  he 
can  begin  taking  pictures. 

—  If  he  has  to  take  on-location  shots  it  may  be  necessary  to  accompany  him  to 
the  location. 

—  If  he  is  to  produce  slides  from  books  or  manuals  provide  him  with  all  necessary 
details. 

•  For  Drawings 

—  If  some  of  the  slides  require  the  production  of  graphs  or  diagrams,  take  these 
story  boards  to  the  graphic  artist  so  he  can  begin  drawing. 

—  When  the  artist  has  drawn  the  visuals,  take  them  to  the  photographer  to  have 
them  photographed. 

•  You  should  now  have  completed  all  the  visual  components  of  the  slide-tape  program. 

•  After  you  have  completed  the  above,  check  Section  2,  number  4  of  the  ID  Checklist. 

•  For  example  of  what  the  ID  Checklist  looks  like  when  you  have  consulted  with 
the  photographer/artist  on  visual  components,  see  page  L-8.  Note  Section  2, 
number  4. 


from  block  32 


to  blo^k  34 


•  Fo*  turttHK  information  and  guidonc a, 
*  btlow 


How  do  I  aompleXe.  tl it  audio  pofution  oi  tko,  4 cAlpt? 

•  You  already  have  the  narration  on  each  frame  of  the  story  board.  To  write  the 
audio  portion  of  the  script,  simply  copy  this  narration  onto  the  script. 

•  Take  the  completed  audio  script  to  the  audio  producer  who  will  arrange  to  have 
a  narrator  do  the  reading. 

•  Note  the  Audio-Visual  Format  below. 

•  For  example  of  what  the  ID  Checklist  looks  like  when  you  have  completed  the 
audio  portion,  see  page  L-8.  Note  Section  2,  number  5. 


Format  for  an  Audio-Visual  Script 


VIDEO 

All  the  visual  sequences  of  the 
program  are  written  on  this 
side  of  the  script. 

Story  board  pictures  ran  be 
illustrated  on  this  side  of  the 
script  to  correspond  with  the 
narration. 


All  narration  and  specific 
directions  for  the  narrator 
are  listed  on  this  side  of  the 
script.  In  an  audiovisual 
script  all  special  direction*; 
that  have  anything  to  do  with 
audio  such  as  music  are  written 
on  the  right-hand  side. 
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from  block  33 


•  For  further  information  and  guidance, 
see  below 


How  do  I  Indicate,  the  4 tide,  changes? 

•  The  final  production  step  is  to  indicate  on  the  audio  script  where  the  slides 
should  change. 

•  Make  a  small  “x”  (or  other  similar  type  mark)  on  the  audio  script  where  the 
slide  is  to  change. 

•  This  mark  will  provide  the  audio  producer  with  the  required  information  for 
synchronizing  the  audio  and  visual  components  of  the  program. 

•  For  example  of  what  the  ID  Checklist  looks  like  when  you  have  indicated  the 
slide  changes,  see  page  L-8.  Note  Section  2,  number  6. 
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from  block  25 


WhaX  tt>  the.  puApoAe.  oft  casing  simple.  wndA  and 
4konX  4znte.nc.eA? 

•  Your  purpose  in  developing  instructional  materials  is  to  help  the  student  to  reach 
the  terminal  learning  objective  and  its  prerequisite  learning  objectives.  The  more 
effectively  you  can  communicate  with  him,  the  more  likely  he  is  to  learn  from 
your  instruction.  Therefore,  it  is  important  NOT  to  exceed  the  student’s  reading 
level  (or  vocabulary  level  if  your  instruction  is  audio-only). 

Writing  that  is  easy  to  read  is  usually  easy  to  understand.  You  should  use  words 
that  the  student  is  familiar  with,  and  put  them  into  fairly  short,  uncomplicated 
sentences. 

The  following  list  of  guidelines  for  lowering  the  reading  difficulty  level  of  your 
instruction  is  divided  into  two  sections:  (1)  Word  Selection  and  (2)  Sentence 
Structure.  (Later  you  will  be  given  a  formula  for  actually  measuring  the  reading 
grade  level  of  your  materials). 


WORD  SELECTION 

1.  Use  SHORT.  FAMILIAR  words  when  possible. 


Poor  Choice 


Better  Choice 


accordingly 

assistance 

facilitate 

utilization 

feasible 

implement 


so 

help,  aid 
help,  ease 
use 

possible 
carry  out 


Reading  studies  show  that  short,  familiar  words  tend  to  communicate  better. 


2.  Use  CONCRETE,  SPECIFIC  words. 
Poor  Choice 
aircraft 

majority  of  soldiers 
physical  needs 
weapon 


Better  Choice 
B-52 

95%  of  soldiers 
hunger  and  thirst 
M-1 6 


Abstract  words  mean  different  things  to  different  people.  Therefore,  they  can  make 
your  intended  meaning  unclear.  Concrete  words  communicate  more  easily  and 
precisely. 


3.  Use  NON-TECHNICAL  words. 

Poor  Choice 

clavical 

NCOIC 

terrain 

experimentation 


Better  Choice 
collar  bone 

non-commissioned  officer  in  charge 

ground 

test 


When  a  technical  word  cannot  be  replaced  by  a  non-technical  word,  and  you  think 
the  word  is  unfamiliar  to  your  student,  explain  the  technical  word  in  a  separate 
sentence  either  d’rectly  before  or  directly  after  its  first  appearance. 

Of  course,  if  your  student  has  a  technical  backpound  in  the  area  of  your  instruc¬ 
tion,  technical  terms  are  appropriate. 

In  the  case  of  military  abbreviations,  it  is  sufficient  to  write  out  the  complete  term 
followed  by  its  abbreviation  in  parentheses  the  first  time;  and  to  use  the  abbreviation 
every  time  afterwards. 

Example;  The  non-commissioned  officer  in  charge  (NCOIC)  gave  the  order.  The 
NCOIC  told  th"  men  to  sh!  le  their  boots. 
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4.  Use  ACTIVE  voice  verbs. 

Poor  Choice:  The  statement  must  be  updated  every  three  months. 
Better  Choice:  You  must  update  the  statement  every  three  months. 
Poor  Choice:  The  truck  will  be  driven  by  Specialist  Jones. 

Better  Choice:  Specialist  Jones  will  drive  the  truck. 


This  suggestion  does  not  mean  that  you  must  never  use  the  passive  voice.  However, 
it  should  be  avoided  when  you  are  writing  instructions  and  procedures,  as  in  the  first 
example;  otherwise,  the  job  may  not  get  done!  (“Who  is  to  update  the  statement,’’ 
is  important  to  your  meaning. ) 


5.  Avoid  changing  action  verbs  into  nouns. 

Poor  Choice:  It  has  been  pointed  out  that,  in  the  Army,  careful  initial  selection  and  classification 

are  important  procedures  in  eliminating  maladjusted  personnel. 

Better  Choice:  If  the  Amy  selects  and  classifies  personnel  carefully,  it  will  have  fewer  mal 
adjusted  people. 

When  verbs  are  changed  into  nouns  it  is  difficult  to  tell  “who  did  what  to  whom.” 


SENTENCE  STRUCTURE 


1.  Use  short,  simple  sentences. 

Poor  Choice 

In  the  case  of  the  habitual 
offender,  theie  is  nothing  to 
do  but  remove  him  from  the 
Service,  needless  to  say,  he  is 
what  might  be  termed  ineffec 
tual  as  an  officer, 


Better  Choice 

Remove  the  habitual  offender  from 
the  Service.  He  is  not  an  effective 
officer. 
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2.  Avoid  strings  of  prepositional  phrases.  Example:  The  hand  of  the  man  on  the 
roof  of  the  house. 

3.  Shorten  prepositional  phrases. 

Poor  Choice 

in  a  manner  similar  to 
with  reference  to 
in  view  of  the  fact 
with  due  regard  for 
in  a  situation  in  which 

4.  Avoid  wasteful  words. 

Poor  Choice 

are  desirous  of 

gained  from  the  following  source 

it  is  recommended  that  con¬ 
sideration  be  given  to 

is  responsible  for  selecting 
make  provision  for 
take  appropriate  measures 
the  fullest  possible  extent 
afford  an  opportunity 

•  For  example  of  what  the  ID  Checklist  looks  like  when  you  have  checked  your 
wr'ting  for  short,  simple  words  and  sentences,  see  page  L-8.  Note  Section  3, 
number  1. 


Better  Choice 

want  to 
from 

we  recommend  that  you  consider 

selects 
provide  for 
act;  do 
the  most 
allow 


Better  Choice 

like 

about 

since 

tor 

when 
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from  block  36 


I 


Ui*/ Check 

Perfoimanc*  QnerUed 
Muting  Style 
(10  Checklist  f 


to  block  38 


•  F  or  further  mt  or  man  on  and  guidance, 
see  beiu* 


tfoa?  do  I  develop  a  peA^oAmanc&~o^u.ent&d 
uvUtlng  Atyle.? 

•  Avoid  Topic-Oriented  Style 

•  Topic-oriented  writing  places  heavy  demands  on  the  reading,  studying,  and 
conceptualizing  skills  of  the  user. 

•  Topic -oriented  writing  focuses  on  the  generalizations  and  concepts  which  con¬ 
stitute  a  body  of  knowledge— it  tells  “about”  a  subject  area  rather  than  telling 
“what  to  do”  or  “how  to  do  it”. 

•  Topic-oriented  materials  do  not  identify  a  particular  user  audience.  A  topic- 
oriented  manual  is  frequently  described  as  a  general  reference  text,  intended 
for  anyone  from  Private  to  General. 

•  Topic-oriented  writing  does  not  identify  subject-related  duties  and  tasks,  who 
might  be  expected  to  perform  them,  or  how  any  given  user  might  perform  them. 
The  description  of  the  “body  of  knowledge”  may  carry  implications  for  duty 
and  task  performance  for  everyone  from  the  Private  to  the  Unit  Commander. 
However,  it’s  left  up  to  the  reader  to  deduce  from  this  description  what  duties 
and  tasks  should  be  performed,  how  they  should  be  performed,  and  who  should 
perform  them. 


•  Do  Develop  Performance-Oriented  Style 

•  Performance-oriented  writing  minimizes  demands  on  the  reading,  studying,  and 
conceptualizing  skills  of  the  user. 

•  Performance-oriented  writing  focuses  on  the  duties  and  tasks  a  user  is  expected 
to  perform  and  the  information  he  needs  in  order  to  perform  these  duties  and 
tasks— it  tells  the  user,  “what  to  do”  and  where  possible,  “how  to  do  it”. 

•  Performance-oriented  writing  identifies  a  particular  user  audience.  To  write 
performance-oriented  literature  you  start  by  identifying  who  you  expect  the 
major  user  to  be  and  the  subject-related  duties  and  tasks  this  user  will  perform. 
You  then  translate  your  knowledge  of  the  subject  area  into  the  information  and 
directions  this  user  will  need  to  learn  and  perform  the  duties  and  tasks  you 
have  identified. 
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•  In  performance-oriented  writing,  information  is  selected  from  the  “body  of 
knowledge”  and  organized  to  place  major  emphasis  upon  its  application  to 
duty  and  task  performance.  It  “talks”  directly  to  the  user,  the  duties  and 
tasks  he  is  expected  to  perform,  and  how  he  can  perform  them.  As  a  result, 
performance-oriented  literature  has  greater  relevance  to  a  job  training  or  job 
performance  setting  than  topic-oriented  literature.  The  reader  does  not  have 
to  strain  the  information  he  needs  out  of  the  general  pot  of  knowledge  and 
then  wrestle  with  the  “so  what  should  I  do  about  it”  question. 
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EXAMPLES  OF  TOPIC-ORIENTED  WRITING  VERSUS 
PERFORMANCE-ORIENTED  WRITING 


TOPIC- ORIENTED  WRITING 


VERSUS  PERFORMANCE-ORIENTED  WRITING 


Thu  puugr  attempt*  to  explain  how  spontaneous  combustion  ,  jf,  V.o-  h  » 
general  thu  information  is  ami  how  it  u  prese niet)  iumplrtplv  sepa/ah-  fi-.m  .n>\  !oi»  -r 
task  performance  context 

EXAMPLE  3-A:  TOPIC-ORIENTED  WRITING 


Ihi*  .‘xanipl.-  n  »  III.  writer  of  (he  l.ipi  i«  -nted  passage  on  Spontaneous 

Healing  ought  bai--  run. I  Ibis  tn«l«Tu#i  f  '.»■  >i»l  Imt r  writing  •  jwfftirman*  e  oriented 
rri4i  ual  f-.r  the  in'roltun-  handler 

EXAMPLE  3ft  PERFORMANCE -ORIENTED  WRITING 


1  Spontatfoiif  Henttnt  Meat  mg  .  *  .-'•<nti<i«ti- 

ble  material,  or  combination  of  material'*.  ;»  d«- 
sen-  d  as  spnntanenu*  if  inherent  chars*  tormin  a 
of  I:  *  material*  came  a  hear  pr«d.irmg  .  hemi.-al 
action  without  exposure  to  external  sour, -ex  ..f 
heat  The  process  is  spontaneous  combustion  if 
ignition  occurs  The  causes  ,.(  spontaneous  heat- 
ing  are  few.  but  the  conditions  under  which  they 
operate  are  many  and  varied  More  thar.  one 
factor  may  be  operative  in  s.-me  vases,  and  one 
may  be  conducive  to  another  Technical  informs 
tion  as  to  the  exact  details  is  limited  laboratory 
testa  are  often  inconclusive  because  «■:'  the  rfilfl 
colty  of  duplicating  operating  condition*  It  is  un 
safe  to  conclude  that  a  material  %  ill  not  hea* 
spontaneously  because  it  has  not  do  ■  so  under  » 
given  set  of  circumstance-  The  pr.*e*«  usually 
starts  with  a  Mow  chemical  re  a-  *  • .  or  slow  ■  xi 
detion,  which  generates  mne  m  it  The  pr  -  ess 
accelerates  as  heat  build*  up  until  r  pul  ox  it.  m 
takes  place  Ignition  may  occur  after  d;.y*  or 
weeks,  during  which  the  temperature  h;is  Wen 
■lowly  increasing  The  process  can  and  doe*  .  •» 
ce*d  in  va.-ious  materials  without  dangerous  .  r 
feels  if  the  heat  generated  can  be  di-  ;«*ted  I: 
dissipated  as  fast  as  generated,  ign.-  ■  n  , -ann.it 
occur  Ventilation  is  therefore  an  imtiortant 
factor  On  the  other  hand,  complete  lark  *'f  vrnti 
lation  is  a  positive  deterrent  Complete  absence  of 
ventilation  would  not  prevent  spontaneous  heat- 
ing  and  ignition  if  a  chemical  source  of  oxygen 
were  present  The  most  common  instan- .  of  spon¬ 
taneous  heating  is  that  which  takes  p'nre  in  oil-  or 
paint-soaked  waste  or  rags,  part  ularly  those 
■oaked  with  linseed  oil  and  paint  driers  Oily 
waste  and  rags  should  not  >-■  left  in  locker*  or 
supply  cupboards,  they  should  la* «  -llerted  in  air¬ 
tight  metal  containers  for  safeke-  mg  until  dis¬ 
posed  of. 


Usmg  the  Petroleum  Gaga  Sock  to  Find  Innag* 

Vmi  can  use  thr  petroleum  gage  stick  to  find  the  height  of  •  product 
l  innafe  i  in  email  horizontal  lank*,  nonprewure  tank  car*,  and  tank  vehicles 
Figure  90 A  shows  the  .  orreel  position  «f  the  gage  stick  in  the  lark  fie  the 
gage  stick  in  this  way 

1 1 »  Lower  the  stick  into  the  lank  vertically 
NOTE 

■  a  I  Lower  the  stick  with  care  to  that  it  toes  noi  make  a  ipUah 
A  splash  can  cause  ■  cut  on  the  sock  which  will  give  you 
the  wrong  reading 

lb i  Make  sure  that  the  stick  reus  on  the  bottom  and  not  on  a 
nvet  head  or  other  projection  inside  the  tank 
1 2  >  When  you  gage  a  small  honxonlil  tank  which  has  a  reference 
point  note  whrthw  the  reading  on  the  gage  slick  at  the  reference 
point  it  the  same  at  the  reference  height  or  the  tank 
i.li  Take  out  the  sink  and  read  the  product  cut  on  the  stick  Record 
this  figure  as  the  irrnage  gage 
(Si  (lean  the  stick  at  the  cut  hy  wiping  with  a  cloth 
1 5|  lower  thr  stick  agvn  and  take  a  aecond  reading 
(fil  Oean  the  stick  with  the  cloth 


CAUTION 

Do  not  leave  oily  rags  lying  around  or  in  lockers  or  supply 
cupboards  They  may  start  heating  and  when  they  become 
hot  enough  they  burst  into  flames  Put  oily  rags  in  airtight 
metal  containers  until  you  can  gel  nd  of  them 
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EXAMPLE: 


Topic-Oriented  Writing 


t.  Crew  Duties. 

( 1 )  Vehicle  commander. 

(a)  Since  the  conventional  round  can  be 
fired  from  a  stationary  vehicle  or  a  moving  ve¬ 
hicle  in  the  stabilized  mode,  after  acquiring  a  tar¬ 
get  the  vehicle  commander  must  issue  directions 
to  the  driver  before  issuing  the  initial  fire  com¬ 
mand  If  the  vehicle  commander  desires  to  fire 
from  a  stationary  vehicle,  he  announces  DRIVER 
STOP,  i;  the  vehicle  commander  desires  to  con¬ 
tinue  moving  while  firing  he  announces  STA¬ 
BILIZED,  and  then  issues  the  fire  command. 

<b)  Acquires  target,  issues  directions  to 
driver,  estimates  range  to  target,  issues  an  initial 
fire  command,  and  lays  gun  launcher  for  direc¬ 
tion. 

(e)  When  the  gunner  announces  IDEN¬ 
TIFIED,  vehicle  commander  releases  control  of 
turret  to  gunner  and  takes  up  a  position  to  ob¬ 
serve  fire.  When  firing  conventional  ammunition, 
the  vehicle  commander  should  brace  himself 
against  reaction  of  the  vehicle  to  shock  pro¬ 
duced  by  firing.  After  initial  shock,  the  vehicle 
commander  may  take  up  his  binocular  and  at¬ 
tempt  to  sense  the  round  if  the  target  is  beyond 
1.200  meters.  If  the  target  is  nearer  than  1,200 
meters,  the  vehicle  commander  should  attempt 
to  sense  the  round  without  aid  of  a  binocular. 
<d)  Adjusts  Areas  necessary. 

(e)  Terminates  engagement  by  announc¬ 
ing  CEASE  FIRE  or  TARGET— CEASE  FIRE. 


Performance-Oriented  Writing 

(M561  ARMORED  RECONNAISSANCE/AIRBORNE 

ASSAULT  VEHICLE.  AR/AAV) 

e.  CREW  DUTIES  DURING  TARGET  ENGAGE¬ 
MENT 

(I)  Duties  of  tne  vehicle  commander 

(a)  The  vehicle  commander  picks  a  target. 

(b)  He  decides  whether  to  fire  with  the 
vehicle  moving  or  stopped.  If  he 
wants  to  fire  while  the  vehicle  is 
stopped,  he  says  DRIVER  STOP.  If 
he  wants  to  fire  while  the  vehicle  is 
moving,  he  says  STABILIZED. 

(c)  He  estimates  the  mnge  to  the  target, 
and  gives  a  fire  command.  Then  he 
lays  the  gun/launcher  for  direction. 

(d)  When  the  gunner  says  IDENTIFIED, 
the  vehicle  commander  gives  control 
of  the  turret  to  him. 

(e)  The  vehicle  commander  gets  in  place 
to  watch  the  fire.  He  must  brace  him¬ 
self  against  the  shock  that  firing 
makes  in  the  vehicle.  After  the  shock, 
he  tries  to  sense  the  round.  He  may 
use  his  binoculars  if  the  target  is  more 
than  1200  meters  away. 

(f)  He  adjusts  fire  as  needed. 

(g)  He  says  CEASE  FIRE  or  TARGET- 
CEASE  FIRE  to  end  the  firing. 


•  For  example  of  what  ID  Checklist  looks  like  when  you  have  checked  your  writing 
for  performance-oriented  style,  see  page  L-8.  Note  Section  3,  number  2. 
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from  block  37 


to  block  39 


•  Fot  lurthti  information  *nt)  guidance, 
see  below 


Hou)  do  I  wphat>lzo,  thz  main  points  l n  the.  tuxt? 

•  As  you  write  a  paragraph,  you  should  make  sure  that  your  main  points  stand  out 
clearly.  Don’t  let  your  writing  become  vague  or  wordy. 

a)  Avoid  Writing  Which  Is  Too  Vague 

A  passage  is  vague  when  it  lacks  proper  subordination.  Main  points  and 
secondary  points  are  run  together  as  if  they  were  equally  important.  The 
reader  must  handle  several  “equal”  details  rather  than  a  few  main  points 
together  with  the  information  which  supports  each  of  them.  The  passage 
lacks  needed  emphasis. 


For  Example: 

Vague  Writing 

c.  Crew  Dutiea. 

(1)  Vehicle  commander. 

(a)  Since  the  conventional  round  can 
be  fired  from  a  stationary  vehicle  or  a  moving 
vehicle  in  the  stabilized  mode,  after  acquiring  a 
target  the  vehicle  commander  must  issue  direc¬ 
tions  to  the  driver  before  issuing  the  initial  fire 
command.  If  the  vehicle  commander  desires  to 
fire  from  a  stationary  vehicle,  he  announces 
DRIVER  STOP.  If  the  vehicle  commander  desires 
to  continue  moving  while  firing  he  announces 
STABILIZED,  and  then  issues  the  fire  command. 


Clear  Writing 


CREW  DUTIES  DURING  TARGET 

ENGAGEMENT 

(1)  Duties  of  the  vehicle  commander 

(a)  The  vehicle  commander  picks  a  target. 

(b)  He  decides  whether  to  fire  with  the 
vehicle  moving  or  stopped.  If  he  wants 
to  fire  while  the  vehicle  is  stopped,  he 
says  DRIVER  STOP.  If  he  wants  to  fire 
while  the  vehicle  is  moving,  he  says 
STABILIZED. 
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b)  Avoid  Writing  Which  Has  Too  Much  Detail 

'loo  much  detail  is  usually  the  result  of  writing  to  more  than  one  user  or 
of  writing  to  no  particular  user  at  all.  Write  to  your  primary  user.  Give 
him  all  the  infoimation  that  he  needs  to  perform  his  job.  Leave  out 
everything  else. 


For  Example: 

Too  Much  Detail 

e.  Several  tracked  vehicles  are  air  transporta¬ 
ble.  Tracked  vehicles  are  usually  moving  long 
distances  by  being  transported  rather  than  by 
proceeding  under  their  own  power.  Instructions 
for  loading  vehicles  on  aircraft  are  provided  in 
the  technical  manuals  of  the  10*500  series.  Rail 
movement  is  probably  used  most.  In  continental 
United  States,  the  Association  of  American  Rail¬ 
roads  has  a  standard  loading  plan  that  specifies 
the  minimum  lashing  and  blocking  for  each  type 
vehicle.  Since  there  are  different  maximum 
requirements  among  the  different  rail  lines,  the 
nearest  agent  will  have  been  consulted  for  partic¬ 
ulars  when  vehicles  are  to  be  loaded  on  railroad 
cars.  Each  unit  usually  becomes  responsible  for 
loading  its  own  vehicles— it  is  necessary  that  you 
learn  how  your  vehicle  must  be  loaded.  The  tech¬ 
nical  manual  for  each  type  vehicle  gives  the 
minimum  requirement*  of  the  Army  for  loading 
and  lashing  the  vehicle.  These  requirements 
usually  closely  parallel  those  of  the  railroad  lines. 
If  you  are  familiar  with  the  requirements  in  the 
technical  manual  it  will  be  very  easy  to  adapt  to 
any  additional  requirements  of  the  rail  tine. 


Concise 

e.  Moving  long  distances.  Tracked  vehicles 
are  not  usually  driven  long  distances.  Instead, 
they  are  moved  by  rail  or  by  air.  Each  unit  loads 
its  own  vehicles,  so  you  need  to  know  how  to 
load  your  vehicle  and  tie  it  down.  You  will  find 
this  information  in  the  technical  manual  for  your 
vehicle.  Learn  it.  If  you  need  to,  you  can  add  to 
this  basic  information  the  requirements  of  the 
railroad  line  or  of  the  particular  type  of  aircraft. 


•  For  example  of  what  ID  Checklist  looks  like  when  you  have  checked  what  main 
points  in  the  text  are  emphasized,  see  page  L-8.  Note  Section  3,  number  3. 


from  block  38 


Otv«  op /Cluck 
ldt«  ClMriy 
|I0  Ctacklutl 


to  block  40 


•  For  lurthvt  information  »nd  guidance 
w*  beiom 


How  do  I  develop  /tdeo6  ct^a/iLy? 

•  When  you  write  a  series  of  paragraphs  or  passages,  your  writing  will  become 
confusing  if  you  do  not  clearly  develop  and  sequence  your  main  points. 

a)  Avoid  Redundancy  Between  Paragraphs 

When  you  think  that  you  are  making  two  different  points,  be  sure  that  one 
isn’t  really  a  restatement  of  the  other.  If  it  is,  you  would  do  better  to 
combine  the  two. 

For  Example: 

Redundant 


Antennas  should  be  located  on  hills  overlooking  the  sur¬ 
rounding  terrain  and  jungle  growth. 


Antennas  should  be  located  as  high  as  possible  when  the 
antenna  site  is  located  directly  behind  an  intervening  terrain 
mask.  If  feasible,  tie  the  radio  set  to  the  top  of  a  tree  and 
operate  it  from  that  location  by  remote  control.  Slight 
tilting  of  an  antenna  away  from  the  direction  of  the  distant 
station  also  will  help  to  breach  an  obstacle. 

Antennas  should  not  be  located  in  narrow  valieyt  or 
between  ridges  or  stretches  of  high  jungle  growth. 


Concise 


Height  of  antenna.  If  you  can,  place  antennas  on  hills  or 
other  high  spots  The  signal  will  then  pass  through  less 
jungle  growth  and  have  a  greater  range.  Never  place  your 
antenna  in  deep  narrow  valleys.  When  the  growth  or  terrain 
is  very  close,  place  the  antenna  as  high  up  as  you  can.  Tie 
the  radio  set  to  the  top  of  a  tree  if  possible,  and  run  it  by 
remote  control. 
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b)  Avoid  Scattered  Information 

Different  information  about  the  same  main  point  should  be  together  and 
not  scattered  throughout  different  paragraphs.  Organize  your  information. 


Example  of  Scattered  Information 


a. 

b 


e. 

f. 

g- 

h. 


refers  to  weapons. 

refers  to  positions, 
refers  to  range  cards. 


refers  to  fire. 


refers  to  fire, 
refers  to  positions. 

refers  to  positions. 

refers  to  weapons. 

refers  to  range  cards. 


The  squad  leader's  responsibilities  during  the 
preparation  of  the  position  include: 

^  (a)  Coordinating  with  crews  and  gunners  of 


all  weapons  located  in  the  squad  area. 

Mb)  Supervising  the  preparation  of  foxholes. 
Me)  Supervising  the  preparation  of  range 


cards  to  include  assisting  in  the  estimation  of  ranges  to 
prominent  terrain  features. 

j>(dl  Insuring  provision  for  delivery  of  fires 
under  conditions  of  limited  visibility,  to  include 
improvised  procedures  for  delivery  of  grazing  fire  by 
rifles  and  automatic  rifles  and  prearranged  grenade 
launcher  fires. 


Supervising  the  clearing  of  fields  of  fire, 
(f)  Supervising  the  preparation  of  supple¬ 
mentary  positions. 

^(g)  Inspecting  positions  to  insure  that 


csmouflage  and  overhead  covers  are  sufficient. 


(h)  Insuring  that  all  weapons  have  their 
it  setting  and  are  operative,  and  that  adequate 


battlesii 

ammunition  is  available  and  distributed. 


I^(i)  Preparing  a  sketch  in  duplicate  of  the 


squad’s  sector  of  fire,  showing  prominent  landmarks  or 
terrain  features  and  the  ranges  to  them.  He  gives  one 
sketch  to  the  platoon  leader  and  keeps  one  copy 
for  himself. 


•  For  example  of  what  the  ID  Checklist  looks  like  when  you  have  checked  that 
ideas  are  developed  clearly,  see  page  L-8.  Note  Section  3,  number  4. 
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from  block  39 


40 

Dtvelup/Uu 
Cle*r  Formn 
HO  Checklist! 


to  block  41 


•  for  lunhei  information  and  guidance, 
see  below 


Hou)  do  I  dzveZop  a.  dtnan.  fiofmcut? 

•  Avoid  a  Run-Together  Format 

A  run-together  format  is  a  solid  mass  of  print.  The  reader  cannot  easily  scan  it. 
He  cannot  easily  identify  and  lift  out  the  separate  points.  The  solution  to  a  run- 
together  format  is  to  break  the  text  up  into  visual  “chunks”  which  group  the 
information  logically.  Proper  visual  chunking  lets  the  reader  scan  and  identify 
the  separate  points  easily. 


For  Example: 

Run-Together  Format 

b.  Reoccupation  of  Position  When  the 
firing  position  is  to  be  reoccupied,  white  tape  is 
stretched  between  the  two  ground  stakes  to 
facilitate  alignment  of  the  tank's  right  or  left 
track.  With  the  shielded  lights  on  the  aiming 
stakes  turned  on,  the  gun  is  traversed  to  the  angle 
of  the  aiming  stakes  and  the  tank  is  moved 
forward  adjacent  to  the  tape  (fig  14-6).  The 
gunner  controls  the  final  positioning  of  the  tank 
by  observing  through  his  sight  until  the  far  light 
appears  to  be  above  and  in  line  with  the  near 
light  at  which  time  the  tank  is  halted.  The  gunner 
then,  using  the  resetter  knob  on  the  azimuth 
indicator,  indexes  the  pre-recorded  deflection  to 
the  aiming  stakes.  The  tank  is  now  positioned  so 
that  the  range  card  data  can  be  used  to 
engage  targets 


Clear  Format 

b.  How  to  Move  into  a  Marked  Position 

(1)  Crewmen  stretch  white  tape 
between  the  two  ground  stakes  to  help  position 
the  tank's  track. 

(2)  They  turn  on  the  lights  on  the  two 
aiming  stakes. 

(3)  The  gunner  moves  the  turret  to  the 
angle  of  the  aiming  stakes. 

(4)  The  driver  moves  the  tank  up  next 
to  the  tape. 

(5)  The  driver  stops  the  tank  when  the 
gunner  sees  the  far  light  above  the  near  light,  and 
in  line  with  it. 

(6)  The  gunner  uses  the  resetter  knob 
on  the  azimuth  indicator  to  index  the  pre¬ 
recorded  deflection  to  the  lighted  aiming  stakes. 

(7)  'Hie  tank  is  now  in  position  to  use 
the  range  card  data. 


•  For  example  of  what  ID  Checklist  looks  like  when  you  have  checked  that  format 
is  clearly  developed,  see  page  L-8.  Note  Section  3,  number  j. 
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from  block  40 


llw/ Check 

Formal*  lo  Determine 
Readtng  Grade  Level  and 
Record 
(10  Checkiitt  1 


to  block  42 


•  The  Reading  Grade  Level  Formula  >s  uied  to 

•  keep  the  writing  at  a  level  appropriate  tor  the 
target  population 

0  For  further  information  and  guidance, 
see  heiow 


How  do  1  use  the  fa ormuta  far  determining  reading 
difa  faculty  level? 

GENERAL  INSTRUCTIONS 

1)  Select  the  150  word  passage  from  connected  discourse.  Do  not  use  this 
formula  to  check  unconnected  statements.  It’s  best  to  start  counting 
■words  at  the  beginning  of  a  paragraph  or  section. 

2)  Counting  the  Words 

Words  include  numbers,  letters,  symbols,  and  groups  of  letters  that  are 
surrounded  by  white  spaces.  Hyphenated  words  and  contractions  are 
counted  as  one  word.  As  an  example,  each  of  the  following  is  counted 
as  one  word:  “couldn’t”,  “F.O.B.”,  “i.e  ”,  “$32,008”,  “second-grade”. 

3)  Counting  the  Syllables 

Count  syllables  the  way  the  word  is  pronounced:  such  as  “row”  has  one 
syllable,  “mention”  has  two.  With  symbols  and  figures  the  syllables  are 
known  by  the  way  they  are  normally  read  aloud,  such  as,  one  syllable  for 
(“cents”),  three  for  R.F.D.  (“are-eff-dee”),  and  four  for  1918  (“nineteen 
eighteen”).  When  in  doubt  about  syllables,  consult  a  dictionary. 


NOTE:  An  important  thing  to  remember  when  using  the  formula  for 

a  quality  control  check  is  to  not  write  to  the  formula.  Your  writing 
should  be  directed  to  the  student,  not  the  formula.  The  formula  serves 
as  a  guide  for  the  reading  difficulty  level  of  material  you  have  written 
and  not  the  material  you  are  getting  ready  to  write. 


SPECIFIC  INSTRUCTIONS 


STEP  1 


Count  the  number  of  one  syllable 

words  in  a  150  ■word  passage. 


Number  of  one 
syllable  words 


79 


STEP  2 


(Bracketed)  Words  Are  One  Syllable  Words 

Adequate  protection  l from)  (thel  elements  land!  environmental  conditons 
[must]  [be]  provided  (by)  [means]  [of]  proper  storage  facilities,  preservation, 
packaging,  packing,  (or)  [a]  combination  [of]  any  [or]  (all)  (of]  [these] 
measures.  |To)  adquately  protect  [most]  items  (from)  [the]  damaging  effects 
[of]  water  [or]  water-vapors,  adequate  preservation  [must]  (be]  provided.  [ *TT»is] 
(is]  often  [true]  even  (though]  (the]  item  (is)  (to |  (be)  (stored]  (in)  [a] 
warehouse  provided  [with]  mechanical  [means]  (of]  controlling  (the]  tempera¬ 
ture  [and]  humidity.  Several  methods  [by]  | which]  humidity  [is]  controlled 
[are]  [in]  (use]  (by]  (the]  culinary  services.  (Use]  (is)  also  (made)  (of] 
mechanically  ventilating  (and]  dehumidifying  selected  sections  (of)  existing  ware¬ 
houses.  Appropriate  consideration  [will]  (be)  givon  (to)  |the)  picparation  [and] 
[care]  (of]  items  (stored]  under  specific  (types]  (of]  storage  (suchl  (as] 
controlled  humidity,  refrigerated,  (and]  heated.  [TTie|  amount  (and]  levels  (of) 
preservation,  packaging,  (and)  packing  (will)  [be]  governed  [by]  [the]  specific 
method  (of)  storage  (plus)  [ the)  anticipated  (length)  (of)  storage. 


Divide  the  number  of  one  syllable  words 

by  10 


10  /79  =  7.9 


STEP  3 


Subtract  the  result  from  2^) 

20.0 

7.9 

Reading  Grade  Level 

to  obtain  the  reading  grade  level. 

12.1 

121 

•  Record  Reading  Grade  Level  on  ID  Checklist.  For  example,  see  page  L-8. 
Note  Section  3,  number  6. 


L-52 


to  block  43 


Supervisor  check  is  useful  for  obtaining  another  persons 
and  for  double  checking  the  item  on  '.he  ID  Checklist 


to  block  44 


1 


from  blocks  44  and  45 

46 

r Conduct  Individual 
Validation  Trials 


to  block  47 


from  blocks  47  and  48 

•  Thu  |ob  aid  don  noi  tovei  the  development  of  an  inttrucioi  t  guide 

•  TRAOOC  Pam  3S0  3Q.  Block  III  4  Develop  Instruction  coven  this  topic 


to  block  50 


4 


< 
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from  block  49 


to  block  51 


•  Thu  job  ltd  don  noi  (.over  the  development  of  *  itudeul  pu.de 

•  TflAOOC  P#m  350-30.  Block  111.4.  Develop  Imtiucuon  coven  (tut  topic 


from  block  51 


Du 1 1 rig  th«  ,ni»uction»l  bevel op<n««t  p'  cx.ro 
iriloiiTwt>on  may  have  been  obtained  tt»*’  would 
be  uufal  to  persons  who  performed  aetiv-t-ej 
that  led  mio  thu  one  Simil*fiT  intormiiioo 
may  have  been  obtained  that  would  be  usetu1  to 
pettont  Mftiu  will  be  enyeged  in  tnitiuct>on*i 
Systems  Development  steps  ihai  tniiow  itns  one 


•  comment*  are  fee  O'."  d  and  sobmitied  to 
appiopnate  persons 

•  Fur  lurther  guidance,  see  below 


STOP  ) 


What  Is  t\ le  Impositance  o {  psie.pcvu.ng  comments  {os i  people 
wosiklng  In  othesi  steps  o {  the  tnstsiuctlonal  systems 
development  pswcess?  How  do  1  siecosid  them? 

•  In  order  for  the  Instructional  Systems  Development  process  to  work  effectively 
it  is  imperative  that  there  be  forward  and  backward  communication  between  the 
people  involved  in  the  process.  At  some  time  or  other  you  have  probably  com¬ 
plained  about  the  input  that  has  been  provided  to  you.  Sometimes,  you  may  have 
had  to  do  work  that  should  have  been  performed  in  previous  steps. 


IT  IS  IMPORTANT  THAT  YOU  FEED  THIS  INFORMATION  BACK 
TO  THE  APPROPRIATE  PEOPLE  SO  THAT  REVISIONS  CAN  BE 
MADE  TO  EFFECT  IMPROVEMENT  IN  THE  END  PRODUCT. 


•  In  your  research  for  this  step  of  the  Instructional  Systems  Development  process 
you  may  have  discovered  additional  information  that  you  think  may  be  useful  to 
people  who  will  be  working  in  steps  that  follow  this  one.  If  so,  it  is  equally 
important  that  you  pass  this  information  on  to  appropriate  people. 


REMEMBER,  COMMUNICATION  WITHIN  THE  INSTRUCTIONAL 
SYSTEMS  DEVELOPMENT  PROCESS  IS  CRITICAL  FOR  EFFECTIVE 
INSTRUCTIONAL  DEVELOPMENT  FOR  SUCCESSFUL  MISSION 
ACCOMPLISHMENT. 


•  A  copy  of  the  ISD  COORDINATION  SHEET  can  he  found  at  the  back  of  this 
manual.  Make  sufficient  copies  to  enable  you  to  send  one  to  every  individual  you 
wish  to  communicate  with— plus  copies  for  your  records, 

•  Complete  the  ISD  COORDINATION  SHEET  in  duplicate.  Send  one  copy  to  the 
individual  and  attach  one  copy  to  the  Instruction  Settings  Selection  Package 
(ISR  Sheets). 
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VALIDATING  INSTRUCTION 


ISD  III. 5 

Manual 


This  is  the  13th  in  a  series  of  ISD  Job  Aids  for  use  in  instructional  design  and 
development.  This  volume  is  to  be  used  as  a  supplement  to  the  primary  document, 
“Job  Aids:  Descriptive  Authoring  Flowcharts  ISD  III. 5  Validating  Instruction.”  The 
flowchart  document  will  direct  you  to  specific  guidance,  examples,  and  references 
provided  in  this  volume.  If  you  do  not  have  the  primary  flowchan  document,  request 
it  from  your  supervisor. 


The  wording  in  this  manual  should  not  be  construed  to 
discriminate  between  the  sexes.  In  order  to  avoid  a 
repetitious  use  of  the  terminology,  "he/she,"  the  terms, 
"he,"  "him,"  and  "his,"  as  well  as  "m  n,"  are  intended 
to  include  both  the  masculine  and  feminine  gender.  Any 
exceptions  to  this  usage  will  be  so  noted. 


ISO  1 1 1.5  Validating  Instruction 


to  block  3 
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from  blocks  1  and  2 


to  block  6 


What  U>  the.  Vatidate.  InAt/aictton  Job  ktd  aJLt  about? 

•  GOAL 

Validation  is  the  process  by  which  instructional  material  (course,  module,  lesson, 
etc.)  is  tested  and  revised  until  you  are  reasonably  sure  it  teaches  what  you  want 
it  to  teach.  The  purpose  of  this  job  aid  is  to  provide  the  procedures  for  con¬ 
ducting  validation  trials. 

There  are  two  types  of  validation  trials  described  in  this  job  aid.  They  are: 

1.  Individual  Validation  Trials— One  trainee  at  a  time  evaluates  the 
effectiveness  of  the  instruction  to  identify  major  “bugs”  in  the 
instructional  material.  After  one  or  more  individual  evaluation  trials, 
needed  revisions  in  the  instruction  are  made.  Individual  Validation 
Trials  continue  until  all  major  “bugs”  have  been  identified  and 
corrected. 

2.  Group  Validation  Trials— The  instructional  material  is  administered 
to  a  group  of  representative  trainees  to  identify  any  problems  (bugs) 
not  identified  in  the  Individual  Validation  Trials.  Again,  necessary 
revisions  are  made  in  the  instruction. 


•  OBJECTIVES 

1.  Given  the  appropriate  directions,  validate  a  proposed  unit  of  instruction. 

2.  Given  the  appropriate  worksheets  and  instruction  on  how  to  fill  them  out, 
document: 

a.  the  number  of  subjects  used 

b.  the  type  of  validation  used 

c.  the  type  of  revisions  needed  (if  any),  for  all  validation  trials. 
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•  PRODUCT 


This  job  aid  will  result  in  a  completed  Instruction  Validation  Recording  Sheet  for 
both  Individual  Validation  Trials  (1VR  Sheet  -  Indiv.)  and  Group  Validation 
Trials  (IVR  Sheet  -  Grp.) 


•  OVERVIEW  OF  MAJOR  STEPS  IN  VALIDATING  INSTRUCTION 

Step  1.  Select  trainee  for  Individual  Evaluation  Trial 

Step  2.  Identify  and  record  major  “bugs”  in  instructional  material 

Step  3.  Determine  whether  another  trainee  should  evaluate  the  instructional 
material  before  any  revisions  are  made 

Step  4.  Repeat  Steps  1  thru  3  until  all  major  “bugs”  have  been  identified 

Step  5.  Record  needed  revisions 

Step  6.  Make  revisions  in  instructional  material 

Step  7.  Determine  if  additional  Individual  Validation  Trial(s)  are  needed.  If 
so,  repeat  Steps  1  thru  6  as  necessary. 

Step  8.  Repeat  entire  process  for  Group  Validation  Trials 

WORKSHEETS  USED 

The  Tables  on  page  M-57  and  M-58  show  a  completed  Instruction  Validation  Recording 
Sheet  for  both  individual  and  group  evaluation. 
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ISD  III. 5  Validate  Instruction 

INSTRUCTION  VALIDATION  RECORDING  SHEET  -  GROUP 
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DESCRIPTIVE  FLOWCHART 

—  The  flowcharts  on  pages  M-57  and  M-58  show  the  steps  in  the  use  of  the  Job 
Aid  for  Validating  Instruction.  The  flowchart  will  be  useful  to  you  in  getting 
a  clear  picture  of  the  overall  process  used  in  this  job  aid.  A  more  completely 
described  flowchart  is  provided  in  ISD  III. 5  Job  Aids:  Descriptive  Authoring 
Flowcharts,  (Validating  Instruction). 


from  block  4  or  5 


to  block  8 


•  Review  includes 

-  Definition 

-  Necessity  for  validation 

-  Pi  oper  time  to  validate 

-  Imptmante  ol  feedback 

-  How  validation  helps  improve  instruction 

•  foi  further  information,  see  below 


What  lt>  the.  pfioceA-t>  oh  validating  tn&t/uiction  alt  about? 

•  DEFINITION 

—  Validation  is  the  final  step  in  the  systematic  design  and  development  of  an 
instructional  program. 

—  It  is  a  process  that  increases  the  probability  of  successful  implementation  of 
a  program  by  IMPROVING,  REVISING,  MODIFYING,  and  CLARIFYING  its 
design  and  structure  before  the  program  is  used  in  the  classroom. 


•  WHY  VALIDATE: 

—  After  all  your  hard  work  you  want  to  be  sure  that  your  program  works.  You 
can  inciease  the  chances  of  having  a  successful  program  of  instruction  by 
trying  it  our  prior  to  implementation  (ISD,  Phase  V).  Thus,  you  have  the 
opportunity  to  revise  your  program  until  it  achieves  what  you  want  it  to 
achieve. 


•  WHEN  TO  VALIDATE: 

—  You  can  try  out  instructional  material  at  any  of  the  following  points: 

1)  After  developing  the  first  sequence 

2)  After  developing  an  entire  module 

3)  After  developing  the  overall  design  of  the  material 

4)  After  developing  the  entire  program 

—  It  is  wise  to  start  the  validation  process  early  in  instructional  development. 
However,  validation  can  occur  at  any  of  the  points  listed  above. 
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•  WHAT  IS  IMPORTANT 

—  The  important  point  about  validation  is  that  FEEDBACK  is  obtained  from  a 
closely  observed  trainee  before  an  instructional  program  is  taken  into  the 
classroom. 


•  HOW  DOES  VALIDATION  HELP: 

—  The  validation  process  can  help  you  eliminate  problems  that  may  occur  in 
three  areas: 

CLARITY  of  your  program  is  maximized  by  making  sure  that: 

a)  the  language  and  reading  level  is  geared  to  the  level  of  the  trainee 
for  whom  the  program  is  intended 

b)  the  instructions  are  precise 

c)  the  material  is  logical  and  sequential 

d)  the  sentence  structure  is  correct  and  meaningful. 

2)  INTEREST  LEVEL  of  the  student  is  determined 

a)  does  the  material  arouse  curiosity— gain  attention? 

b)  does  it  cause  boredom,  or  apathy,  or  disinterest? 

3)  PRESENTATIONAL  FORM 

a)  is  it  appropriate  and  well  paced? 

—  need  to  improve  visuals,  diagrams,  charts? 

—  does  instructional  sequence  cover  too  much,  or  not  enough, 
ground  for  this  level? 

—  are  more  or  less  feedback/reinforcers  needed? 

—  are  tests  too  easy /difficult? 
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from  block  6  and  7 


Obtain  Instruction 
Validation  RKO'dmq 
$h«*t  Individual 
llVR  ShMt  - Indml 


to  block  9 


■  Instruction  ValnJition  Rnording  Shwt  Individual  (IVR  Sh«c(  Ind'V  )  rs  uted 
to  documtnt  the  Individual  TnaKlI  Validation  proem 
•  ^iit  quittance  m  obtammy  IVR  Sheet  Indiv  see  beuivv 


Wh.2A.2.  do  I  geX  Jyib&iuction  Vcitickition  R2.doh.dlng  ShdeX6? 

•  There  are  two  Instruction  Validation  Recording  Sheets  used  with  this  job  aid: 

—  Instruction  Validation  Recording  Sheet  -  Individual  (IVR  Sheet  -  Indiv.) 

—  Instruction  Validation  Recording  Sheet  •  Group  (IVR  Sheet  -  Grp.) 

•  The  IVR  Sheet  -  Grp.  is  on  the  reverse  side  of  the  IVR  Sheet  -  Indiv. 

•  The  Instruction  Validation  Recording  Sheets  are  available  for  duplication  in  the 
pocket  aL  the  end  of  this  manual. 


•  To  see  an  example  of  completed  IVR  Sheets,  refer  to  page  M-6  and  M-7. 


from  block  8 


Complatt  Sac 1 1 on  I  of 
I VR  ShMl-Indiv 


to  block  10 


•  Information  mcludad  in  Stcuon  I  is  as  follows 

-  Count  MOS  Code 

-  Skiff  toft 

-  Instruction  urdar  development 

-  Instruction  being  validated 
Individual  Validation  Trial  Number 

•  Foi  guidance  m  completing  Section  I  of  IVR  Sheet  Indiv  .  set  below 


How  do  I  complete  Section  I  ofi  the  Instruction 
Vatldatlon  Recording  Sheet  -  Indlvtdual? 

•  COURSE  MOS  CODE  AND  SKILL  LEVEL  designation  is  the  MOS  and  skill 
level  for  which  the  instructional  material  is  being  developed. 

•  INSTRUCTION  UNDER  DEVELOPMENT  may  be  an  entire  course,  module, 
lesson,  etc.  that  you  are  working  on.  It  can  contain  more  than  one  piece  of 
instructional  material. 

•  INSTRUCTION  BEING  VALIDATED  may  be  only  one  piece  of  instructional 
material  (e.g.,  a  slide-tape)  from  the  entire  course,  module,  etc.  that  is  being 
developed.  Sometimes,  however,  Instruction  Under  Development  and  Instruction 
Being  Validated  are  the  same  thing. 

•  INDIVIDUAL  VALIDATION  TRIAL  NUMBER  refers  to  the  specific  product 
you  are  validating  at  this  time.  Within  an  individual  trial,  more  than  one 
trainee  should  be  used  to  evaluate  the  material  before  revisions  are  made. 

Each  trainee  would  be  tested  on  the  material  individually  in  order  to  gain 
information  on  what  kinds  of  revisions  are  necessary.  This  would  consti¬ 
tute  TRIAL  NUMBER  1.  After  revisions  are  made,  new  trainees  may  be 
tested  on  the  material  (again,  they  would  be  tested  individually)  and  new 
revisions  would  be  indicated.  This  would  constitute  TRIAL  NUMBER  2. 

The  process  would  be  continued  until  you  decided  that  no  more  useful 
information  could  be  obtained  from  further  individual  trials. 


—  Another  way  of  looking  at  this  is: 


Trainee  1 
Trainee  2  (_ 

Trainee  3  f 
etc.  . 


Trial  No.  1 


Trainee  1 
Trainee  2 
Trainee  3 
Trainee  4 


1 


etc. 


Trial  No.  2 


Trainee  1 

Trainee  2  V  Trial  No.  3 
etc.  I 


ETC. 


Wkcut  dca>  the  Il/R  Sheet  -  Individual  look  like  when 
Section  1  hcu>  been  completed? 


Example: 


ISD  III  5  Validate  Instruction 

INSTRUCTION  VALIDATION  RECORDING  SHEET  -  INDIVIDUAL 


0 


from  block  9 


Study  CuiiMintt  lor 
Validation  Using 
Individual  Trial 
Evaluationli) 


to  block  1 1 


•  Gtbdflirm  tiplain  the  proem  of.  and  procadutts  used  in.  a  validation  tnai  usinq 
a  tingle  trainee  at  a  subject 


•  fo<  further  information,  tee  below 


What  guldcLinet  &  ho  old.  be  followed  tn  conducting 
vatldation  u&tng  tndlvtduat  tnlat  evaluation? 

•  CONDUCTING  INDIVIDUAL  EVALUATIONS: 

1)  During  the  individual  evaluation  of  instructional  material,  a  single  trainee  is 
closely  observed  as  he  uses  the  material.  Wherever  the  trainee  has  difficulty 
or  seems  uncertain,  this  should  be  carefully  noted,  even  if  it  concerns  only 
one  teaching  point.  If  the  trainee  has  trouble  understanding  or  applying 
one  rule  or  principle,  more  than  likely  he  will  have  difficulty  in  accomplish¬ 
ing  the  behavior  to  which  that  rule  or  principle  applies. 

2)  During  the  process  of  validation,  it  is  very  important  that  both  the  instruc¬ 
tional  materials  developer  and  the  trainee  understand  their  roles  in  the 
process.  You  should  explain  to  the  trainee  that  he  is  not  being  evaluated, 
but  the  system  is.  Trainees  need  to  be  urged  to  participate  actively  and 
respond  as  required.  It  is  through  the  feedback  provided  by  the  trainee 
that  you  can  determine  the  adequacy  of  the  instructional  materials.  You 
must  remember  that  the  failure  of  the  trainee  to  perform  competently  at 
this  stage  is  a  reflection  on  the  instruction  and  not  the  trainee. 

3)  After  the  trainee  has  completed  the  unit  of  instruction  and  the  criterion 
examination,  he  should  be  encouraged  to  discuss  any  areas  in  which  he 
experienced  difficulty.  Several  individual  evaluations  should  be  conducted 
before  any  significant  changes  are  made. 


•  USE  OF  INDIVIDUAL  EVALUATION  RESULTS: 

When  certain  error  patterns  occur  during  successive  evaluations,  it  is  an  indication 
that  revision  is  necessary.  For  example,  if  several  trainees  fail  to  meet  the 
standard  of  performance  established  for  a  particular  criterion  objective,  the 
instruction  leading  to  that  objective  needs  to  be  analyzed  and  revised.  If  the 
instructional  unit  has  to  be  revised  significantly,  it  would  be  best  to  conduct  one 
oi  more  individual  evaluations  to  check  the  results  of  the  modifications.  However, 
if  the  instructional  sequence  is  basically  sound  and  requires  only  minor  changes,  a 
group  validation  can  be  started.  (Group  Validation  is  discussed  later  in  the  manual). 
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from  block  10 


•  This  Wock  togmi  ih*  individual  Validation  TriaMi)  pocaa. 


to  block  12 
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from  block  12 


Salact/Rtcofd  Validation 
MtttiodU)  to  b«  Uad  in 
Evaluation 
I  Section  II.  Block  B. 

IVR  SftMt  -Indrv  ] 


to  block  14 


•  Math,  i  uud  m  validation  in 

-  T«a  -  Inte/vievfl 

-  Qimnoniwra  -  Observation 

Attitude  Scalts  -  Othai  methodi  specific  to  tha  training  situation 

•  f  oi  lurihei  explanation,  sea  below 


What  axe  *ome  method*  ti&ed  tn  the  validation  pxoeei>6? 

•  There  are  a  number  of  methods  that  may  be  used  to  obtain  various  types  of  infor¬ 
mation  during  the  validation  process.  The  decision  to  revise  instructional  units 
is  based  on  these  responses. 


•  VALIDATION  METHODS: 

1)  Tests:  To  obtain  scores  from  the  trainees  who  are  being  used  as  subjects 
in  the  validation  process. 

—  There  are  four  general  types  of  tests: 

1)  Entry  tests 

2)  Pretests 

3)  Posttests 

4)  Within-course  tests 

—  Patterns  of  incorrect  test  responses  indicate  the  possibility  that  instructional 
material  is  not  clear  in  particular  areas.  Since  each  test  item  is  referenced 
to  a  particular  element  of  a  task,  it  is  relatively  easy  to  identify  the  prob¬ 
lem  area. 

—  Pre/posttest  scores  allow  you  to  compute  the  learning  gain  achieved  by 
the  material. 

2)  Questionnaires:  To  collect  data  on  the  effectiveness  of  the  format  and 
content  of  the  material. 

—  Questionnaires  provide  direct  feedback  from  the  trainee  on  those  areas 
which  he  feels  need  improvement. 

3)  Attitude  Scales:  To  collect  data  on  the  attitudes  of  the  trainees  toward 
the  instructional  unit. 

—  Attitude  scales  indicate  whether  or  not  the  trainee  was  motivated  by 
the  instructional  unit. 
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4)  Interviews:  Can  be  used  instead  of  No.  2  (Questionnaires)  and  No.  3 
(Attitude  Scales)  above. 

—  Interviews  provide  an  open-ended  format  which  allow  the  trainees  to 
express  themselves  more  fully.  However,  interviews  are  usually  more 
time  consuming  than  the  other  methods. 

5)  Observation:  To  collect  data  on  those  areas  of  the  instructional  unit  that 
seem  to  be  confusing  to  the  trainee. 

—  Your  observations  are  the  most  important  element  in  this  process  because 
your  impressions  may  form  the  basis  of  instructional  revision. 
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Wkcut  dozA  I l/K  Sheet  -  7 ndividual  look  tike,  token  method 
uAed  Ion.  evaluation  iA  n.econ.ded  In  Suction  II, 

Block  B? 


Example: 


ISD  III  5  Validate  Instruction 

INSTRUCTION  VALIDATION  RECORDING  SHEET  -  INDIIflOUAL 


IIVR  Sheet  -  lnd.«r) 


SECTION  1  COURSE  DESCRIPTION 

Courv  MOS  yj  P  Sk'l*  ''‘v1,1  JJ- 

ImtlJCIion  unite*  li.tliuU 

rti!*womiier»t_2^(t_rjjris^  ng  •  <t„ui-tl fjocfy /»  .£  _ 

*._  / _ 

from  block  13 


Select/Retu'd  Trainee  to 
be  Used  m  (valuation 
[Section  II.  Block  C. 

IVH  Sheet  -Indiv  i 


•  1  i«<uees  who  are  representative  of  the  target  population  are  selected  a;  subjects 

•  For  tunher  guidance,  see  below 


to  block  15 


How  do  I  choose  a.  sample.  tnju.n2.0j>  on  which  to  conduct 
an  ZndZvZduaZ  tnZaZ  vatidation? 

•  INDIVIDUAL  TRAINEE  SAMPLING: 

—  The  individual  trainee  should  be  representative  of  the  intended  target  population. 
The  trainees  selected  for  the  purpose  of  validation  should  fall  within  the  range 
of  aptitudes,  prior  knowledges,  skills,  and  background  of  the  typical  target 
population. 

—  Those  trainees  who  are  selected  should  possess  higher  aptitudes  within  the 
targe1,  population  range.  If  they  have  trouble  learning  ti  ■  material,  then 
obviously  the  material  would  be  too  difficult  for  the  less  capable  trainee.  Also, 
the  higher  aptitude  trainee  will  be  better  able  to  point  out  weak  areas  in  the 
instructional  unit. 

What  dooj  Il/R  Sheet  -  IndlvZduaZ  Zook  to  fee  when 
Section  II,  BZock  C  "Tnjunee  and  lm>ViuctionaZ 
Penjonnel  U^ed"  Zi>  fiZCZed  Zn? 

Example: 

ISD  III  5  Validate  Instruction 

INSTRUCTION  VALIDATION  RECORDING  SHEET  -  INDIVIDUAL 


SECTION  1  COURSE  DESCRIPTION 

. . .  .  Si  P 

X 

. . . . ’iBa.SK.  Firi*  C'l 

r\0jui*  \.  c?r 

■  - .  / 

SECTION  M  EVALUATIONS  BY  TRAINEE 


—  5K  i 

. .  VMS  Z  CO 


OlnLl*  /A  *'  Cm 


E  l 

-  '  fl  C.,  Br 

SFC  Olhe. 

-  vmo 

I-,-,.,  to/ toy  if 
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from  block  14 


Prapan  Vdittadon 
Recording  Form(i) 
(VR  Forms) 


to  block  16 


•  Validation  Racoidmg  Forms  inetudr 

-  Questionnaires 

-  Altitude  Suits 

-  Interview  Forms 

-  Observation  Forms 

•  For  guidance  m  preparing  Validation  Recording  Faints,  see  below 


I 

I 

? 

i 


1 


.i 


y 


Hou)  do  I  pKupouiz  Validation  Rzc.OA.ding  Foajm  [  VR  Vonrn )  ? 

•  The  purpose  of  the  test  trials  is  to  collect  information  about  the  trainees,  the 
materials,  and  the  procedures.  You  must  have  a  system  for  collecting  and  record¬ 
ing  the  data  so  that  decisions  can  be  made  based  on  the  data.  There  is  no  point 
in  collecting  particular  data  unless  you  intend  to  use  it. 

—  Usually  you  will  need  data  such  as: 

a)  background  information  on  the  trainees 

b)  results  of  pretests,  entry  level  tests,  attitude  measures,  and  within-course 
test  items 

c)  validator’s  comments  to  trainees 

d)  trainees’  questions  and  remarks 

e)  length  of  time  required  on  different  parts  of  the  instructional  program 

f)  results  of  posttest  and  interviews 

•  Guidelines  for  constructing  validation  recording  forms: 

—  Attitude  scales: 

A)  Attitude  scales  are  used  to  collect  information  about  the  trainee’s  feelings 
toward  the  unit  of  instruction.  The  following  are  examples  of  the  type  of 
question  that  you  may  want  to  include: 

1)  Did  the  activity  help  the  trainee  achieve  the  criterion  on  the 
learning  objective? 

2)  Did  the  trainee  learn  skills  that  he  expected  to  use  on  the  job? 

3)  What  did  the  trainee  think  about  the  activity’s:  a)  level  of  difficulty, 
b)  vocabulary  level,  c)  pace,  d)  etc.? 

4)  Did  the  trainee  think  that  the  activity  was  interesting? 

5)  Did  the  trainee  feel  pressured? 

6)  Would  the  trainee  prefer  a  different  type  of  instruction? 

7)  Did  the  trainee  think  that  the  material  was  clearly  presented? 

8)  ETC. 
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B)  In  general,  attitude  scales  should  be  constructed  so  that: 

1)  the  items  are  worded  in  such  a  manner  that  the  trainee  has  a  range 
of  choices. 

2)  the  choices  provide  for  positive,  negative  and  neutral  positions 
along  the  scales.  For  example: 

This  activity  was: 


Too  Simple  Average  Too  Hard 

3)  the  items  are  counter-balanced  (the  reversing  of  positive  and  negative 
poles  on  each  successive  item)  to  avoid  response  sets  (the  tendency 
to  arbitrarily  check  off  the  same  response  when  answering  a  list 

of  questions). 

4)  both  the  trainee  and  the  scorer  are  able  to  tell  which  responses  are 
positive  and  which  are  negative. 

—  Trainee  background  information: 

Examples  of  background  information  that  you  may  want  to  gather  about  the 
trainee  include  the  following: 

1)  Trainee’s  name 

2)  Trainee’s  grade 

3)  Highest  level  of  education 

4)  Time  in  service 

5)  Trainee’s  MOS 

6)  Time  in  MOS 

7)  Title  of  present  job 

8)  ETC. 
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—  Data  gathered  through  observation: 

You  are  the  most  important  part  of  the  observation  process.  Your  interpreta¬ 
tions  of  what  you  see  when  the  trainee  is  engaged  in  the  learning  activities, 
become  the  data  on  which  your  decisions  will  be  based.  The  following  are 
some  suggestions  of  what  to  look  for  when  observing  a  trainee: 

1)  How  long  does  it  take  the  trainee  to  complete  the  task? 

2)  Does  one  particular  area  of  the  instructional  unit  seem  to  present 
a  stumbling  block  to  the  trainee’s  progress? 

3)  Does  the  trainee’s  attention  seem  to  wander,  indicating  areas  that 
may  be  boring  or  too  difficult? 

4)  What  problems  did  the  trainee  encounter  using  the  material.  For 
instance,  were  instructions  easily  understood? 

5)  ETC. 

—  Results  of  written  tests: 

Besides  looking  at  how  many  items  were  passed  and  how  many  were  failed,  it 
is  important  to  look  at  tests  results  to  see  whether  incorrect  responses  seem 
to  group  around  one  particular  area  of  the  instructional  unit.  That  is,  did  the 
trainees  consistently  answer  incorrectly  the  material  dealing  with  one  or  two 
particular  points.  This  information  would  indicate  an  area  of  the  instructional 
unit  that  you  may  want  to  consider  revising. 

—  Data  from  interviews: 

1)  The  same  type  of  information  as  was  obtained  through  attitude  scales 
may  be  gained  through  face-to-face  interviews  with  the  trainee.  Both 
techniques  have  their  advantages  and  disadvantages. 

2)  The  advantage  of  an  interview  is  that  the  trainee  can  answer  your  questions 
in  an  open-ended  style.  He  can  give  you  as  much  information  as  he  wishes 
without  the  constraints  of  space  provided  on  a  page. 

3)  This  open-ended  style  of  answering  questions  may  then  lead  you  to  think 
of  other  questions  you  want  to  ask. 
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In  general,  the  following  guidelines  should  be  followed  when  con- 

constructing  validating  recording  forms: 

1)  Don’t  use  terms  or  ask  questions  about  topics  that  your 
respondent  will  not  know  about. 

2)  Make  sure  that  any  answer  the  respondent  makes  will  have  a 
clear  meaning  to  you. 

3)  Don’t  ask  people  to  make  undesirable  choices. 

4)  Don’t  lead  your  respondents  by  wording  the  item  so  they  will 
know  what  answers  you  want. 

5)  Make  the  item  and  the  choices  short,  and  use  simple  words. 

6)  Make  certain  the  item  clearly  specifies  what  you  want  the 
respondent  to  do. 

7)  Don’t  ask  respondents  to  do  several  things  in  one  item. 

8)  Don’t  ask  for  several  kinds  of  information  in  one  item. 

9)  Don’t  use  tricky  wording,  especially  double  negatives. 

10)  Don’t  ask  for  fine  distinctions,  unless  you  know  they  will  be 
meaningful  to  your  respondents. 

11)  Don’t  word  your  question  in  such  a  way  that  the  balance  of 
responses  will  unavoidably  be  in  one  direction  (loading). 

12)  Be  sure  your  answers  are  worded  so  that  someone  who  disagrees 
with  you  can  find  an  answer  presenting  his  side  of  the  issue. 
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from  block  15 


to  block  17 


•  Methods  «•  dticuatd  lor  prawnution  of  irartructional  mittoil.  They  mcluda. 

-  Who  ihoiHd  promt  tht  malarial 

-  Location  (stta)  lor  praatnution 

-  Amount  of  malarial  to  ba  prawn  tad 

•  For  further  information,  ut  brio* 


(JJkat  one.  the.  vaxiouA  uxiyi  that  tn&tAucttonal  mateJviaJU, 
may  be.  ptiet>e.nte.d? 

•  WHO  PRESENTS  THE  MATERIAL: 

—  Material  may  be  presented  by  validation  personnel  or  by  course  instructors. 

If  presented  by  course  instructors,  their  observations  of  the  trainee’s  perform¬ 
ance  can  become  an  important  part  of  the  validation  process.  If  you  are 
presenting  the  material,  you  should  plan  to  record  your  observations.  If 
course  instructors  are  presenting  the  material  you  should  record  their 
observations. 

•  WHERE  MATERIAL  IS  PRESENTED: 

—  On  an  individual  evaluation,  material  may  be  presented  any  place  that  is  both 
convenient  and  has  the  proper  equipment.  This  may  be  your  office  or  the 
actual  site  where  course  instruction  will  take  place  (e.g.,  classroom). 

•  HOW  MUCH  MATERIAL  SHOULD  BE  PRESENTED: 

—  On  the  first  individual  trial,  present  all  of  the  material  to  be  validated.  On 
subsequent  trials,  once  revisions  have  been  made,  you  may  want  to  present 
only  those  parts  of  the  instructional  material  that  has  been  revised. 
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•  Forms  may  aiit»r  be  titled  out  by  the  trainee  (c  q  .  an  attitude  scale}  01  by  the 
percents}  conducting  the  validation  (e  g  .  responses  to  an  interview} 


•  Forms  at*  analysed  lor  patterns  ot  responses  or  other  information  indicative  of 
whether  or  not  revision  ot  material  is  necessary 


to  block  19 


from  block  18 


tawd  ftoaltt  of 
fvefcrtlren 
(Section  II.  Block  0. 
IVR  Sheet -ln*v  1 


to  block  20 


•  Followwig  txampiK  of  typ«  of  information  thai  fhould  be  worded 

-  PHtttru  at  corrtct  iiKOHKt  rHponm 

-  Indtcaiiom  of  problem  area  mihm  tta  instruction*  nuteriei 

-  Trameei  comment,  where  et-rficable 


•  Fo'  fuithar  ym  dance.  m  below 


What  type,  cfi  Information  might  I  nee ond  on  the  IVR 
Sheet  -  Individual,  Section  II,  Block  V? 

•  Information  gained  from  the  validation  process  is  recorded.  Examples  of  the 
kind  of  information  that  should  be  recorded  are- 

a)  areas  of  difficulty  in  understanding  instructional  material— e.g.,  the  vocabu¬ 
lary  level  was  too  high  for  trainees. 

b)  areas  of  difficulty  in  the  way  the  material  was  presented— e.g.,  the  pace 
was  too  fast. 

c)  comments  of  trainees’  that  lead  you  to  believe  that  revisions  should 
be  made— e.g.,  the  material  seemed  to  be  boring. 

d)  ETC. 

What  doet>  IVR  Sheen  -  Individual  look  like  u)hen  the 
neAultb  of  the  evaluation  one  necon ded  In 
Section  II,  Block  V? 

Example: 

INSTRUCTION  VALIDATlUn  ... 


(IVR  Sheet  -  Indiv) 


SECTION  I  COURSE  DESCRIPTION 

Cuo’W  MOS  code  raP  _ _ 

Inilruerion  undf*  - 

development  *Q<t  J  (  c,  Fl  t  A-4 

SECTION  II  EVALUATIONS  BY  TRAINEE 

A  ISD  Pe'ionnel  Conducting  E«*luJl  on 


I*1  "HI  .JlHlefril  .tiodvh,  L  CJ>% 


T  - --  »*!t 

'  —  Own. . 4Co, 

w...  £Fc.  Oil 

■’>’* . .  ■  .JWAfJL _  ._ 

9«r  (.  «-  tOJtOjyS 


Co uH  SAjwer  nyiiw  ft*  p*j*J  ^  \ 


from  block  19 


OtUf iTMfN  ii  Addition*! 
Tmnat  it  NmiM  Prior 
to  Rovitton  ot 
Instruction 


to  block  21 


•  for  guiferct  in  dtttf  mining  it  an  additional  trwnat  rfiould  ba  uaad  to 
avaluatt  th?  instructional  matanal.  wa  Mow 


t 


How  do  1  determine  i{  an  additZonai  tnainee  i&  needed 
within  a  validation  tniai? 

•  Your  own  judgment  becomes  very  important  here.  The  decision  to  use  another 
trainee  before  revisions  are  made  should  be  based  on  whether  or  not  you  see 
some  pattern  to  the  types  of  responses  you  are  getting.  Once  a  pattern  has  been 
established  (i.e.,  you  are  getting  just  about  the  same  information  from  each 
individual)  you  can  begin  to  plan  for  revision  of  material.  Usually  3-5  trainees 
per  trial  constitute  a  good  sample. 

•  Don’t  forget,  you  are  working  with  a  “law  of  diminishing  returns.”  That  is, 
most  information  will  be  obtained  from  the  first  few  trainees.  The  results 
obtained  from  testing  many  more  additional  trainees  may  not  be  worth  the 
time  and  effort  that  is  involved. 


* 
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from  block  22 


Record  Summary  of 
Required  Rr*tvora 
[Section  III. 
IVRSheei-Indtv.l 


to  block  25 


•  For  example,  see  below 


\flhcut  dou  I  UR  Sk<L<Lt  -  Indiv-Ldimt  took  -Like.  wh en 
AummaAy  o&  n.e.quuAe.d  sizvtbtovu  -u  n.<Lc.0Kdnd  tn 
Szcitlon  Ill? 

Example: 

I  Orpnitilicin _ 


0  Rmulii  of  Evaiud 


,irimGTlCA3iS 

_ ’ 


from  block  24 


to  block  28 


•  tabnon  Mill  nwnuJIy  lx  m»<x  by  ihe  indiwjduxli)  atm  dnilogxd  th, 
instruction  being  evaluated 


•  For  example,  se«  below. 


What  do<it>  Il/R  Sheet  -  Individuat  Zook  tike,  when  date, 
sievi* ton  it>  compZeted  Z&  n.eco>ided  In  Section  111? 

Example: 


tc 


;  i  t  «*■ 


from  block  27 


Q«t«mtne  it  Monona! 
INDIVIDUAL  Validation 
Tnai  i  i  Needed 


to  block  29 


•  When  i mv dm  lewlimg  tiom  the  pieviout  Individual  Validation  Trial  were 
extensive,  an  additional  Individual  Validan-  ,  Trial  may  be  dev  table 

•  Fo /  mlormtuon  and  guidance,  see  below 


How  do  1  deXeAtru.no.  i&  additional  validation  inUalA 
axe.  ne.e.de.d? 

•  Generally,  the  decision  as  to  whether  additional  Individual  Validation  Trials  are 

needed  will  be  based  on  such  considerations  as: 

a.  If  the  previous  Individual  Validation  Trial  indicated  that  no  revisions  were 
needed,  then  additional  Individual  Validation  Trials  are  not  needed. 

b.  The  previous  validation  trial  may  have  disclosed  a  “bug”  which  required 
immediate  correction,  (i.e.,  you  didn’t  even  get  through  all  the  material.) 

In  this  situation  you  would  need  an  additional  Individual  Validation  Trial. 

c.  A  large  number  of  revisions  have  been  made  as  a  result  of  the  previous 
validation  trial.  You  will  probably  want  to  have  an  additional  Individual 
Validation  Trial  to  determine  that  you  have  not  introduced  new  “problems” 
as  a  result  of  the  revisions. 

d.  Whenever  in  doubt,  conduct  another  Individual  Validation  Trial. 
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from  block  29 


Study  GuiiMtim  to* 
Validation  Using  Group 
Trial  Evaluation^ 


to  block  32 


•  Guidelines  explain  the  process  and  procedures  used  m  a  validation  trial  in  vtAiich 
a  group  ot  trainees  is  used  to  evaluate  the  instruction  material. 

•  Foi  guidelines,  see  below 


What  guidelines  should  be  followed  in  conducting 
validation  using  gAoup  tkiaJL  evaluation? 

•  CONDUCTING  GROUP  EVALUATIONS: 

—  The  reason  for  trying  out  instruction  on  a  group  of  trainees  is  to  determine 
how  that  portion  of  the  instructional  system  functions  under  conditions 
similar  to  the  actual  classroom  situation.  Too,  it  is  more  economical  to 
gather  data  concerning  the  effectiveness  of  instruction  from  groups  than 
it  is  from  individuals.  Therefore,  validation  trials  are  expanded  to  groups  of 
trainees  as  soon  as  satisfactory  results  are  obtained  with  individual  trials. 

—  At  this  point  in  validation,  time  becomes  a  factor.  It  is  not  sufficient  that 
a  trainee  learns  the  material  in  an  instructional  sequence;  the  trainee  must  also 
complete  it  within  a  reasonable  period  of  time.  Therefore,  in  a  group  trial, 
the  time  needed  by  each  trainee  to  complete  an  instructional  unit  should  be 
tabulated  in  addition  to  recording  the  accuracy  of  trainee  responses. 

—  Some  effort  should  be  made  to  establish  the  maximum  number  of  trials  the 
trainee  would  be  permitted  in  order  to  reach  criterion  performance.  Trainees 
who  are  allowed  continuous  trials  and  still  do  not  attain  success  become  frus¬ 
trated  and  agitated.  These  behavioral  reactions  do  not  complement  the  training 
effort.  A  remedial  program  with  a  new  approach  or  smaller  steps  may  well 
be  the  alternative. 

•  USE  OF  GROUP  EVALUATION  RESULTS: 

—  The  group  trial  should  be  a  success  because  of  the  nature  of  the  pro¬ 
cedures  for  individual  trials.  It  is  likely  that  any  instructional  changes 
will  be  minor.  As  in  the  individual  trials,  if  a  segment  of  instruction 
undergoes  a  significant  revision,  another  group  of  trainees  should 
be  given  the  modified  instruction  until  additional  data  is  gathered  and  final 
revisions  are  made. 

—  This  cycle  of  teaching,  testing,  analyzing,  and  modifying  is  continued  until  it 
is  proven  that  the  trainees  can  perform  to  the  level  specified  in  the  standards 
for  the  objectives. 


from  block  31 


Complete  Section  I  ol 
Instruction  Validation 
Recording  Sheet-Group 
(f VR  Sheet-Group 


•  Instruction  Validation  Racordmg  Sheet  -Group,  is  on  reverse  side  of 
IVR  Sheet -Indiv 

•  Foi  example,  see  below 


to  block  33 


What  dooA  InAt/iuiCtton  Validation  Sktet  -  Gfioup 
(JVR  Sktzt  -  Gsip)  look  like.  whm  Station  I 
haA  been  complettd? 

Example: 


ISD  III  5  Validate  Instruction 

INSTRUCTION  VALIDATION  RECORDING  SHEET  -  GROUP 


SECTION  1  COURSE  DESCRIPTION 

Courve  MOS  ccMle  S  3  P 

Group  Valcdat^on,**^*,,,,,^ 

Instruction  under 

development  OftSl  t  Fi'r&+  Aid 

liHMiq  validated  od  S//*  /(  CPR  TualNo  / 

_ Z 

[  SECTION  II:  EVALUATIONS  BY  GROUPS  OF  TRAINEES 

_ / 

A  l5D  Personnel  Conducting  Evaluation 

B  Methodlsl  Used  lor  Evaluation 

C  t lament  anri  IntttuCtional  Personnel  Uted 

tor  Evaluation 

Name 

Tnii 

Number 

0>  (Miration 

Ou«|.or.na„», 

Trainee  Orgam/ation 

Altitude  Sraiet 

Instructor 

Interview* 

Oiganiratinn 

Other  fSpet'ty' 

0*1  r  Inf 

D  Results  ol  Evaluation 

■*>-**11*^.. 
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from  block  33 


Recotd  ISO  Peiionnel 
Con  dueling  Evaluation 
[Section  il.  Bloch  A. 
IVR  Sheet -Gtpl 


•  The  name  end  oiganuetion  ol  the  individuel(j)  conducting  the  evaluation  u 
lecotded 

•  Foi  e 'ample,  see  below. 


to  block  35 


What  doeA  ll/R  Sheet  -  Gwp  look  Lika.  oohen  peAAonnel 
conducting  evaluation  has  been  necomded  In 
Section  II,  Block  A? 


Example: 


ISD  III  5  Validate  Instruction 

INSTRUCTION  VALIDATION  RECORDING  SHEET 


GROUP 


from  block  34 


Select/Record  Validation 
Methodts)  10  tM  Uted  m 
Evaluation 
(Section  U.  Block  B. 

IVR  Shoet-Grpi 


to  block  36 


•  The  validation  method!*)  u ted  in  Croup  Validation  Trialt  are  the  same  at  lor 
Individual  Validation  Trial*  They  are 

-  Tettt  -  Interview# 

-  Quttiionnaira  -  0 baervetron 

-  Attitude  Scales  -  Other  methods  specific  to  the  training  situations 

•  For  example  of  how  to  record  validation  methods,  see  below. 


What  doet>  Il/R  Sheet  -  Gap  look  like  when 
validation  methodic)  have  been  aecoaded  in 
Section  II,  Block  B? 


Example: 


ISD  III. 5  Validate  Instruction 

INSTRUCTION  VALIDATION  RECORDING  SHEET  -  GROUP 
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from  block  35 


S«toctJR«c»d  Group  (o 
bt  UwJ  in  Evaluation 
[Saction  II.  Block  C. 
IVR  Sh**t-G/p) 


to  block  37 


•  Groups  of  trainaai  who  ait  representative  of  Ihe  target  population  ara 
WifCtKj  H  Subject*. 

•  For  further  guidarvci,  see  bviov. 


How  do  I  choose  a  6  ample.  t/iOtnee6  to 

conduct  a  gsicup  tvial  validation? 

•  GROUP  TRAINEE  SAMPLING: 

—  The  trainees  selected  for  this  phase  of  validation  should  also  represent  the 
target  population.  The  selections  should  include  an  even  distribution  of  low, 
average,  and  high  aptitude  trainees. 

—  Up  to  this  point,  the  success  of  the  system  may  have  been  a  result  of  limiting 
trainee  sampling  to  those  with  the  higher  aptitudes.  Now  you  need  to  see  if 
the  same  instruction  is  just  as  efficient  in  teaching  trainees  with  lesser  ability. 
Trainees  with  lower  aptitudes  should  be  able  to  accomplish  the  assigned 
learning  tasks,  though  it  may  take  them  longer  to  complete  the  sequence, 
complete  the  sequence. 

What  doe&  II l/R  Sheet  -  Gsip.  Zook  ZZke  when  Section  II, 
BZock  C,  "ThJitneek  and  InAtAuctional  PeuonneZ 
U&ed  £oa.  Evaluation"  li  filled  Zn? 


Example: 


ISD  III. 3  Validate  Instruction 

INSTRUCTION  VALIDATION  RECORDING  SHEET  -  GROUP 


SECTION  I:  COURSE  DESCRIPTION 

Course  MOS  cods  5*3  P _ 

Instruction  under 

dawlopnwnt  Kane  rirst  _ 

SECTION  II:  EVALUATIONS  BY  GROUPS  OF  TRAINEES 


(IVR  Sheet  -  Grp) 


Instruction 

b*m9  xlidilKl^odu  /c  L  C  P  fi 


A.  ISO  tatonrwl  Conducing  Evaluate 


B  Mathodli)  Ured  for  Evaluate 


C  Trainee*  and  ln*t<uctio"il  Pertonnel  l 
lor  Evaluation 


from  block  36 


Prvpgti  VM'fetion 
flacwding  Poimil) 
(Vfl  Form! 


to  block  38 


•  Validation  Racordutg  Fount  <0f  Group  Validation  T nab  art  MMAfiaily 
tti*  tama  at  for  Individual  Validation  Trials  Thty  induda 

-  OuastionnMrn 

-  Attitudt  Scaln 

-  Intarvitw  Forms 

-  Otearvition 

•  For  guidance  m  preparing  Validation  Rtco'dmg  Formt  sae  beuw 


Hoiv  do  I  ptizpatiz  VaZldaiion  R&co  siding  Fosum 
( t/R  Fosuru s)  t $oa  gsioup*  ofi  iAainzeA? 

•  The  guidelines  given  on  pages  M-21  through  M-24  of  this  manual  for  preparing 
VR  Forms  for  individual  trainees  also  apply  to  groups  of  trainees. 

•  In  addition,  you  will  probably  want  to  prepare  a  form  that  will  enable  you  to 
see  at  a  glance  which  areas  of  the  unit  of  instruction  are  causing  difficulty  for 
your  group.  This  would  probably  take  the  form  of  a  summary  table.  It  would 
need  to  convey  the  following  types  of  information: 

1)  Trainees’ responses 

2)  Number  of  trainees  making  a  particular  response 

3)  Number  of  questions 

4)  Number  of  trainees  passing  each  question 

5)  Number  of  trainees  constituting  each  group 

6)  ETC. 
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Vbj*cti*e 


For  Example 


data  simuy 
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Posttest 
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from  block  37 

•  Methods  (it  disused  tot  pintnution  of  tti«  instructional  material  10  a 
group  of  trainaet 

•  For  turiher  information,  tea  below 


to  block  39 


{jJhout  factor  do  I  con&tdoA  In  pAc&cntcng  in&&iu.c- 
tiomJL  mcutc/ual  ducting  gtioup  vatldcutcon  &UaLb? 

•  For  administration  of  Group  Validation  Trials  you  should  duplicate  the  actual 
instructional  situation  as  nearly  as  possible. 

1.  Use  instructional  personnel  who  will  normally  give  this  particular  instruction. 

2.  Use  the  actual  instructional  setting  (i.e.,  classroom,  lab,  etc.) 

3.  Have  all  equipment,  tools,  etc.  available. 

4.  To  the  extent  possible  have  available  all  auxiliary  material  (handouts, 
slides,  displays,  etc.). 

•  The  personnel  conducting  the  validation  trial  (you)  should  try  to  maintain  a 
low  profile.  You  do  not  want  to  influence  the  outcome  of  the  validation  trial. 


M-42 


from  block  38 


•  Forms  may  be  filled  out  by  trainees  (attitude  scale),  instructor  (comments), 
validation  team  (interviews! 


to  block  40 


1 


*  Forms  nt  analyud  tor  p«tttrm  within  ih*  group  0>  citftoi  information 
■ndicjljvf  of  or  not  rtviHW  o f  Willful  n  nocatu'y 


from  block  40 


to  block  42 


What  doe*  li/R  Sheet  -  Gup.  look  like,  when  xe&ultA 
o£  evaluation  axe  aecosided  -in  Section  II,  Block  V? 

Example: 


M-45 


f/otu  do  1  deteArrUne.  an  addutionat  gsioup  evaZuaJxon 
oi  the,  dnAtsaicitional  mat&Ual  Li>  needed  bzfaotiz 
n.z.vAj>lonA  ajie.  made.? 

•  In  genera],  you  should  follow  the  same  guidance  as  was  given  for  Individual 
Validation  Trials  (page  M-28).  Usually  you  will  not  require  very  many  Group 
Validation  Trials  before  a  revision  is  made.  Consider  the  following: 

1.  If  a  problem  is  disclosed  that  effect  a  large  percentage  of  the  trainee 
group  you  can  be  fairly  certain  that  this  is  indeed  a  problem  for  the  typical 
trainee.  You  would  not  need  additional  Group  Validation  Trials  to  con¬ 
firm  the  existance  of  the  problem. 

2.  If  only  a  few  trainees  in  the  group  have  a  specific  problem  with  the  instruc¬ 
tion  you  might  want  to  consider  having  the  instruction  administered  to 
another  group  to  determine  that  revisions  are  indeed  called  for. 


fi  om  block  42 


Wkcut  do  a  I l/R  Sheet  -  Gup.  look  Like.  when  "no 
tievLt>lon  needed"  16  seconded  In  Section  III? 

Example: 

•»*«« 

_ fn«rvt»w 

_  _  Olhei  Iwetify) 


_ 

Ii»mer  Oig*i'i/«liun_ 

InsHuClor _ 

0rgjn./jfmn_ _ 

[)<1«  Gi«Pii  tntlrudiUi 


from  block  46 


to  block  48 


r 


from  block  48 


49 

Recoid  Date  Rev  mom 

Completed 

{Section  III. 

1 VR  Sheet 

Gipl 

•  Eof  «>4mpt*  Uf  tttiDK 


to  block  50 


( Vhat  dou  Il/R  Sheet  -  Gsip.  look  Like,  when  the.  date 
that  tievlilon 4  have,  been  completed  asie  accorded 
In  Section  Ill ? 


Example: 


•tom* _ 

Orfeniiafion 


T*»t* 

Qunlidnnairn 
Aitituti*  Scale* 
interview* 

Other  (weedy)  _ 


lo>  EvJual'On 

Trainee _ _ 

Trainee  Orpimution 
Inilructoi 

Organization _ 

Date  Given  Imiiuction 


from  block  49 

so  _  I  _ 


Ckttrmme  it  Additional 
Group  Validation  Trial 
is  Needad 


to  block  51 


•  When  revisions  resulting  from  the  previous  Group  Validation  1  rial  were 
ei tensive,  an  additional  Group  Validation  Trial  may  tie  desirable 

•  For  furthei  information  and  guidance,  set  below. 


Hou)  do  I  determine  i&  additional  grump  validation 
tntaJU,  ant  needed? 

•  The  decision  process  for  determining  whether  additional  group  validation  trials 
are  needed  is  similar  to  that  for  Individual  Validation  Trials  for  convenience, 
it  is  repeated,  in  part,  here. 

•  Generally,  the  decision  as  to  whether  additional  Group  Validation  Trials  are 
needed  will  be  based  on  such  considerations  as: 

a.  If  the  previous  Group  Validation  Trial  indicated  that  no  revisions  were 
needed,  then  additional  Group  Validation  Trials  are  not  needed. 

b.  The  previous  validation  trial  may  have  disclosed  a  “bug”  which  required 
immediate  correction,  (i.e.,  you  didn’t  even  get  through  the  entire  material.) 
In  this  situation  you  would  need  to  have  an  additional  Group  Validation 
Trial. 

c.  A  large  number  of  revisions  have  been  made  as  a  result  of  the  previous 
validation  trial.  You  will  probably  want  to  have  an  additional  Group 
Validation  Trial  to  determine  that  you  have  not  introduced  new  “problems” 
as  a  result  of  the  revisions. 


from  block  61 


Submit  Compfettd 
IVR  Sheets  to 
Supervuoi 


to  block  54 


j 


4 


« 


V 


) 


from  block  53 


r  ■ 


•  During  the  instruction  validation  process  information 
may  have  been  obtained  that  would  be  useful  to 
Yes  persons  who  performed  activities  that  fed  mto  the 

"  1  "1  Instruction  Validation  process  Similarly, ml ormauon 

may  have  been  obtained  that  would  be  useful  to 
persons  who  will  be  engaged  m  Instructional  Systems 
Development  steps  that  follow  this  one 


(  STOP 


*5 

Record  Corr 
ISD  COOR 
SHEET 

r"" 

menu  on 
DINATION 

•  Comments  are  recorded  and  submitted  to 
appropriate  persons. 

•  For  further  guidance,  see  below. 


What  Ia  the,  Impontance  o&  pAepaAtng  comment A  Ion. 
people  working  In  otken.  AtepA  ofi  the  InA tAuctlo not 
AyAtemA  development  pn.oceAA?  Hou)  do  Z  n.econ.d  them? 

•  In  order  for  the  Instructional  Systems  Development  process  to  work  effectively 
it  is  imperative  that  there  be  forward  and  backward  communication  between 
the  people  involved  in  the  process.  At  some  time  or  other  you  have  probably 
complained  about  the  input  that  has  been  provided  to  you.  Sometimes,  you  may 
have  had  to  work  that  should  have  been  performed  in  previous  steps. 


IT  IS  IMPORTANT  THAT  YOU  FEED  THIS  INFORMATION  BACK 
TO  THE  APPROPRIATE  PEOPLE  SO  THAT  REVISIONS  CAN  BE 
MADE  TO  EFFECT  IMPROVEMENT  IN  THE  END  PRODUCT. 


In  your  research  for  this  step  of  the  Instructional  Systems  Development  process 
you  may  have  discovered  additional  information  that  you  think  may  be  useful 
to  people  who  will  be  working  in  steps  that  follow  this  one.  If  so,  it  is  equally 
important  that  you  pass  this  information  on  to  appropriate  people. 


REMEMBER,  COMMUNICATION  WITHIN  THE  INSTRUCTIONAL 
SYSTEMS  DEVELOPMENT  PROCESS  IS  CRITICAL  FOR  EFFECTIVE 
INSTRUCTIONAL  DEVELOPMENT  FOR  SUCCESSFUL  MISSION- 
ACCOMPLISHMENT. 


M-55 


A  copy  of  the  ISD  COORDINATION  SHEET  can  be  found  in  the  pocket  at 
the  end  of  this  manual.  Make  sufficient  copies  to  enable  you  to  send  one  to 
every  individual  you  wish  to  communicate  with— plus  copies  for  your  records. 

Complete  the  ISD  COORDINATION  SHEET  in  duplicate.  Send  one  copy  to 
the  individual  and  attach  one  copy  to  the  Instruction  Validation  Recording 
Sheet  (IVR  Sheet). 
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Retold  Rhu'h  ot 
Evaluation 
ISacoon  II.  Block  0 


